-- Logs begin at Thu 2021-10-28 11:30:06 UTC, end at Thu 2021-10-28 12:34:47 UTC. -- Oct 28 12:03:57.054227 dv-cinder-815712-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 12:03:57.063618 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 12:03:57.065586 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 28 12:03:57 2021] *** Oct 28 12:03:57.065586 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 12:03:57.065586 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 12:03:57.065586 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: nodename: dv-cinder-815712-4-iscsi Oct 28 12:03:57.065586 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: machine: x86_64 Oct 28 12:03:57.065586 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: clock source: unix Oct 28 12:03:57.065586 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: pcre jit disabled Oct 28 12:03:57.065586 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: detected number of CPU cores: 4 Oct 28 12:03:57.065586 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: current working directory: / Oct 28 12:03:57.065586 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: detected binary path: /usr/bin/uwsgi-core Oct 28 12:03:57.066239 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: your processes number limit is 47680 Oct 28 12:03:57.066239 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: your memory page size is 4096 bytes Oct 28 12:03:57.066239 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: detected max file descriptor number: 2048 Oct 28 12:03:57.066239 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: lock engine: pthread robust mutexes Oct 28 12:03:57.066239 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: thunder lock: enabled Oct 28 12:03:57.066239 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 12:03:57.066239 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 28 12:03:57.109310 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: Python main interpreter initialized at 0x55f2b2a499c0 Oct 28 12:03:57.109310 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: python threads support enabled Oct 28 12:03:57.109310 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: your server socket listen backlog is limited to 100 connections Oct 28 12:03:57.109310 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: your mercy for graceful operations on workers is 90 seconds Oct 28 12:03:57.110258 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 12:03:57.110258 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: *** Operational MODE: preforking *** Oct 28 12:03:57.110485 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: *** uWSGI is running in multiple interpreter mode *** Oct 28 12:03:57.110485 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: spawned uWSGI master process (pid: 100800) Oct 28 12:03:57.110726 dv-cinder-815712-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 28 12:03:57.111805 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: spawned uWSGI worker 1 (pid: 100801, cores: 1) Oct 28 12:03:57.111805 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: spawned uWSGI worker 2 (pid: 100802, cores: 1) Oct 28 12:03:57.111805 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 12:03:58.764757 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:03:58.764757 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: from cryptography.utils import int_from_bytes Oct 28 12:03:58.765455 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:03:58.765455 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: from cryptography.utils import int_from_bytes Oct 28 12:03:58.770019 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:03:58.770019 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: from cryptography.utils import int_from_bytes Oct 28 12:03:58.770513 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:03:58.770513 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: from cryptography.utils import int_from_bytes Oct 28 12:04:01.441119 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 12:04:01.441733 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 12:04:01.441887 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 12:04:01.442179 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 12:04:01.442431 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 12:04:01.442859 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.443185 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.443505 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.443820 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.444145 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.444452 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.444770 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.445085 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.445409 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.445667 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.445983 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.446301 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815712-4-iscsi {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.446615 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.447225 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.447831 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.447831 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.448078 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.448249 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.448549 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.448671 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 12:04:01.449080 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.449225 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 12:04:01.449660 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 12:04:01.450305 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 12:04:01.450462 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 12:04:01.450589 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.450845 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.450982 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.451165 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.451307 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.451497 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.451629 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.451810 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.451935 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.452110 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.452261 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.452434 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.452614 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.452733 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.452854 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.453072 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.453725 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.453889 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.454020 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.454163 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.454299 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815712-4-iscsi {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.454470 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.454600 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.454824 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815712-4-iscsi {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.454968 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.455218 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.455340 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.455567 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.455702 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.455884 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.456024 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.456204 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.456336 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.456497 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.456592 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.456829 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.456983 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.457117 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.457254 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.457450 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.457632 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.457780 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.458069 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.458197 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.458392 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.458520 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.458721 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.458919 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.459100 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.459259 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.459425 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.459616 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.459750 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.459871 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.460049 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.460185 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.460311 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.460451 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.460570 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.460698 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.460828 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.460954 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.461081 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.461317 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.461443 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815712-4-iscsi {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.461636 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.461850 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.461982 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.462109 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.462226 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.462346 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.462476 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.462670 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.462830 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.463014 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.463192 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.463320 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.463452 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.463621 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.463749 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.463948 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.464068 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.464285 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.464415 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.464586 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.464716 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.464891 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.465020 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.465192 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.465324 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.465503 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.465631 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.465818 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.465937 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.466131 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.466265 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.466435 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.466553 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.466776 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.466919 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.467089 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.467216 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.467398 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.467524 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.467656 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.467783 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.467950 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.468067 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.468276 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.468397 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.468598 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.468756 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.469477 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.469676 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.469832 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.469995 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.470190 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.470383 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.470544 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.470722 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.470902 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.471055 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.471208 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.471369 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.471519 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.471677 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.471830 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.472022 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.472182 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.472344 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.472495 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.472655 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.472902 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.473094 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.473258 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.473426 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.473586 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.473738 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.473897 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.474049 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.474234 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.474403 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.474555 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.474748 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.474903 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.475074 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.475270 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.475436 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.475595 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.475595 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.475898 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.476058 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.476227 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.476390 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.476549 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.476701 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.476858 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.477016 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.477186 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.477338 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.477498 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.477660 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.477824 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.477984 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.478144 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.478303 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.478461 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.478628 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.478807 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.478970 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.479123 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.479293 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.479460 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.479644 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.479907 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.480078 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.480253 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.480418 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.480577 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.480744 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.480906 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.481067 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.481219 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.481370 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.481539 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.481692 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.481851 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.482017 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.482182 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.482334 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.482496 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.482649 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.482830 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.483083 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.483248 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.483399 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.483563 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.483714 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.483880 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.484040 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.484192 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.484352 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.484352 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.484650 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.484817 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.484970 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.485130 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.485282 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.485432 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.485593 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.485759 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.485913 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.486064 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.486215 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.486370 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.486522 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.486710 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.486866 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.487030 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.487183 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.487335 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.487496 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.487668 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.487668 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.487973 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.488143 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.488305 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.488459 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.488629 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.488782 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.488943 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.489097 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.489257 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.489418 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.489571 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.489770 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.489976 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.490139 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.490301 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.490573 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.490785 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.490951 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.491102 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.491254 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.491405 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.491567 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.491719 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.491890 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.492043 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.492194 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.492347 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.492515 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.492676 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.492832 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.492984 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.493219 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.493390 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.493543 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.493701 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.493852 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.494020 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.494173 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.494334 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.494492 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.494644 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.494821 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.494983 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.495134 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.495294 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.495446 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.495598 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.495749 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.495905 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.496068 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.496229 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.496387 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.496540 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.496691 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.496850 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.497015 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.497167 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:04:01.497318 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.497470 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.497630 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.497630 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.497963 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.498136 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.498289 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.498440 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.498598 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.498800 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.498954 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.499120 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.499120 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.499423 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.499580 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.499733 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.499938 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.500138 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.500292 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.500452 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.500634 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.500787 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.500953 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.501112 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.501272 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.501426 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.501595 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.501778 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.501940 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.502102 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.502265 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.502417 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.502569 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.502569 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.502901 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.503062 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.503260 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.503433 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.503586 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.503747 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.503909 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.504062 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.504233 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.504396 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.504557 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.504725 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.504882 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.505035 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.505200 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.505353 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.505465 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.505582 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.505582 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.505877 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.506036 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.506212 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.506390 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.506556 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.506749 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.506915 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.507068 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.507068 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.507373 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.507526 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.507687 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.507847 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.508017 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.508170 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.508347 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.508500 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.508652 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.508803 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.508956 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.509113 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.509285 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.509438 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.509589 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.509741 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.509900 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.510094 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.510306 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.510460 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.510636 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.510846 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.511008 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.511172 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.511326 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.511480 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.511639 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.511792 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.511945 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.512112 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.512269 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.512433 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.512587 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.512738 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.512899 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.513061 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.513216 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.513399 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.513571 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.513728 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.513962 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.514119 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.514285 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.514440 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.514606 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.514796 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.514969 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.515129 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.515291 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.515445 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.516119 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.516278 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.516445 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.516599 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.516599 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.516902 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.517055 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.517219 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.517219 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.517521 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.517521 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.517857 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.517857 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.518161 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.518318 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.518472 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.518628 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.518830 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.518982 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.519151 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.519304 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.519456 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.519609 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.519761 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.519761 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.520067 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.520260 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.520459 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.520614 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.520821 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.520978 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.521140 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.521303 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.521455 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.521608 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.521759 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.521925 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.522077 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.522229 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.522381 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.522532 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.522706 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.522883 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.523042 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.523205 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.523370 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.523561 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.523726 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.523894 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.524056 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.524219 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.524382 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.524545 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.524723 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.524886 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.525041 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.525194 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.525346 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.525509 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.525669 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.525848 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.526004 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.526173 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.526328 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.526482 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.526646 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.526871 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.527032 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.527185 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.527337 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.527488 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.527666 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.527820 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.527975 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.527975 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.528280 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.528441 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.528603 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.528755 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.528907 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.528907 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.529197 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.529358 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.529533 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.529685 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.529837 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.530002 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.530155 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.530326 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.530524 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.530669 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.530826 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.531016 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.531163 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.531991 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.532133 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.532254 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.532390 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.532517 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.532638 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.532776 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.532896 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.533038 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.533180 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.533301 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.533420 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.533551 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.533669 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.533793 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.533922 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.534060 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.534193 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.534323 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.534443 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.534574 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.534720 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.534841 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.534976 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.535097 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.535225 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.535398 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.535567 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.535696 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.535696 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.535949 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.536071 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.536193 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.536314 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.536434 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.536565 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.536693 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.536812 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.536966 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.537087 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.537207 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.537341 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.537462 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.537581 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.537701 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.537829 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.537963 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.538081 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.538209 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.538328 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.538448 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.538580 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.538731 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.538869 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.539029 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.539146 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.539269 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.539388 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.539529 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.539647 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.539767 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.539886 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.540019 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.540147 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.540299 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.540435 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.540623 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.540808 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.540928 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.541068 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.541191 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.541311 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.541431 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.541562 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.541680 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.541817 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.541940 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.542097 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.542216 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.542353 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.542497 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.542788 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.542912 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.543048 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.543177 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.543304 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.543424 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.543555 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.543677 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.543807 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.543973 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.544092 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.544227 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.544349 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.544469 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.544588 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.544712 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.544862 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.544994 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.545115 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.545235 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.545235 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.545462 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.545646 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.545780 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.545912 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.546038 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.546165 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.546285 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.546409 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.546544 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.546663 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.547084 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.547206 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.547324 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.547459 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.547587 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.547708 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.547842 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.547961 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.548080 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.548211 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.548355 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.548483 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.548602 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.548602 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.548829 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.548964 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.549084 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.549204 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.549336 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.549457 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.549577 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.549707 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.549828 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.549955 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.550083 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.550210 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.550338 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.550456 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.550575 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.550775 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.550945 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.551063 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.551221 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.551394 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.551525 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.551658 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.551779 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.551902 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.551902 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.552145 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.552266 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.552407 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.552527 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.552651 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.552774 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.552915 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.553034 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.553157 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.553278 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.553402 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.553524 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.553664 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.553784 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.553945 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.554086 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.554338 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.554473 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.554748 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.554887 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.555008 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.555292 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.555495 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.555628 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.555880 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.556032 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.556225 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.556348 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.556553 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.556693 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.556866 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.557029 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.557159 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.557279 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.557461 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.557595 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.557769 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.557892 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.558079 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.558204 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.558387 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.558521 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.558712 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.558861 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.559017 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.559140 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.559325 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.559447 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.559625 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.559757 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.559938 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.560061 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.560245 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.560366 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.560543 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.560713 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.560911 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.561095 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.561232 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.561420 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.561542 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.561707 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.561831 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.562015 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.562136 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.562316 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.562464 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.562653 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.562848 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.562979 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.563113 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.563272 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.563395 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.563572 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.563696 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.563879 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.564071 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.564192 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.564389 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.564511 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.564700 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.564833 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.565037 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.565168 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.565291 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.565416 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.565639 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.565764 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.565969 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.566098 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.566225 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.566354 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.566526 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.566650 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.566860 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.567089 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.567210 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.567404 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.567526 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.567714 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.567836 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.568045 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.568168 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.568344 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.568476 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.568645 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.568776 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.568946 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.569071 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.569253 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.569374 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.569553 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.569674 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.569856 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.569978 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.570154 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.570276 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.570452 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.570573 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.570774 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.570900 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.571110 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.571273 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.571406 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.571580 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.571737 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.571860 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.572048 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.572183 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.572350 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.572484 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.572673 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.572795 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.572979 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.573120 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.573282 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.573404 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.573595 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.573718 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.573907 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.574041 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.574215 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.574348 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.574520 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.574640 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.574861 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.574983 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.575152 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.575274 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.575456 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.575580 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.575762 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.575893 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.576073 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.576193 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.576364 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.576486 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.576664 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.576797 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.576965 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.577087 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.577284 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.577406 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.577594 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.577726 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.577899 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.578020 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.578750 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.578895 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.579076 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.579274 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.579398 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.579591 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.579723 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.579908 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.580038 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.580225 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.580346 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.580553 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.580676 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.580858 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.580979 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.581193 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.581332 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.581486 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.581649 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.581790 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.581895 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.582096 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.582224 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.582402 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.582538 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.582735 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.582863 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.583040 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.583162 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.583346 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.583485 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.583648 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.583769 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.583952 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.584075 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.584258 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.584392 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.584564 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.584687 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.584864 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.584996 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.585170 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.585312 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.585472 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.585595 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.585776 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.585898 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.586080 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.586199 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.586423 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.586550 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.586807 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.586969 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.587108 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.587246 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.587496 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.587630 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.587819 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.587954 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.588125 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.588246 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.588437 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.588558 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.588748 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.588880 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.589052 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.589173 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.589369 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.589492 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.589689 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.589822 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.590001 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.590124 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.590309 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.590433 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.590616 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.590790 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.590969 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.591091 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.591273 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.591414 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.591594 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.591755 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.591926 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.592079 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.592242 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.592378 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.592545 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.592680 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.592862 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.592984 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.593166 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.593286 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.593489 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.593633 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.594349 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.594479 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.594635 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.594782 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.594994 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.595115 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.595277 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.595475 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.595610 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.595787 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.595929 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.596096 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.596236 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.596425 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.596566 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.596742 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.596871 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.597064 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.597191 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.597371 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.597489 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.597682 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.597810 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.597987 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.598106 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.598307 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.598423 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.598615 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.598769 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.598946 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.599071 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.599256 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.599379 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.599559 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.599682 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.599868 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.599989 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.600189 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.600310 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.600501 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.600623 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.600822 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.600943 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.601206 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.601379 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.601521 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.601665 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.601845 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.601977 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.602193 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.602351 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.602472 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.602594 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.602785 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.602913 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.603089 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.603228 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.603398 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.603521 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.603701 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.603833 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.604006 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.604144 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.604326 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.604450 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.604630 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.604796 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.604935 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.605056 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.605233 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.605354 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.605540 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.605674 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.605842 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.605965 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.606144 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.606266 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.606721 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.606850 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.607001 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.607134 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.607264 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.607397 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.607517 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.607651 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.607787 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.607909 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.608062 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.608201 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.608321 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.608579 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.608713 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.608887 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.609028 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.609189 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.609311 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.609515 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.609637 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.609815 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.609950 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.610155 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.610290 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.610458 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.610580 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.610796 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.610922 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.611114 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.611236 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.611442 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.611580 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.611745 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.611867 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.612068 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.612211 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.612389 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.612524 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.612698 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.612820 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.613010 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.613131 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.613329 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.613465 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.613631 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.613754 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.613933 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.614066 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.614239 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.614375 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.614541 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.614665 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.614870 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.614994 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.615174 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.615313 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.615482 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.615629 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.615782 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.615925 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.616085 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.616223 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.616384 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.616534 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.616704 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.616836 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.617005 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.617128 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.617324 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.617447 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.617647 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.617846 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.617978 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.618109 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.618277 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.618400 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.618615 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.618773 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.618983 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.619124 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.619291 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.619426 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.619622 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.619747 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.619936 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.620055 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.620254 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.620376 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.620572 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.620706 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.620878 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.621000 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.621203 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.621329 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.621513 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.621708 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.621828 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.621953 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.622131 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.622324 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.622495 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.622632 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.622835 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.622954 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.623081 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.623205 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.623372 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.623507 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.623683 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.623804 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.623995 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.624117 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.624310 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.624446 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.624627 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.624749 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.625118 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.625244 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.625463 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.625586 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.625818 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.625951 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.626125 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.626248 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.626437 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.626562 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.626776 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.626921 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.627089 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.627214 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.627402 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.627527 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.627713 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.627837 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.628025 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.628161 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.628337 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.628464 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.628654 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.628775 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.628969 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.629104 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.629278 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.629404 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.629589 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.629713 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.629899 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.630034 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.630209 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.630333 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.630518 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.630653 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.630847 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.630966 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.631173 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.631294 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.631482 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.631616 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.631806 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.631929 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.632077 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.632202 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.632443 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.632599 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.632742 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.632877 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.633001 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.633140 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.633273 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.633411 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.633578 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.633705 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.633975 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.634103 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.634286 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.634464 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.634586 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.634739 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.634923 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.635062 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.635238 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.635373 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.635561 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.635685 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.635892 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.636012 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.636208 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.636351 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.636522 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.636645 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.636835 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.636958 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.637152 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.637275 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.637472 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.637657 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.637790 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.637971 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.638106 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.638302 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.638625 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.638769 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.638972 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.639097 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.639287 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.639422 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.639603 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.639728 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.639927 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.640062 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.640230 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.640365 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.641037 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.641186 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.641358 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.641492 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.641666 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.641790 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.641977 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.642166 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.642297 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.642524 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.642657 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.642811 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.642938 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.643064 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.643218 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.643352 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.643476 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.643604 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.643893 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.644026 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.644215 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.644338 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.644535 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.644668 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.644854 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.644976 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.645219 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.645362 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.645541 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.645673 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.645846 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.645984 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.646165 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.646284 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.646469 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.646602 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.646795 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.646944 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.647112 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.647296 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.647468 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.647589 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.647727 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.647865 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.647988 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.648116 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.648287 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.648414 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.648579 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.648717 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.648882 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.649005 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.649190 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.649311 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.649573 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.649715 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.649910 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.650042 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.650218 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.650341 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.650524 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.650657 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.650848 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.650972 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.651150 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.651283 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.651456 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.651715 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.651838 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.652049 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.652188 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.652335 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.652455 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.652646 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.652839 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.652970 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.653100 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.653239 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.653364 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.653527 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.653650 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.653834 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.653958 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.654137 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.654260 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.654444 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.654568 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.654768 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.654909 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.655089 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.655213 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.655391 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.655514 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.655690 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.655828 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.656001 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.656124 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.656896 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.657070 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.657190 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.657387 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.657509 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.657649 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.657774 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.658076 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.658199 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.658391 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.658514 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.658764 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.658949 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.659099 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.659332 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.659476 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.659653 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.659778 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.659994 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.660129 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.660330 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.660454 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.660639 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.660762 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.660945 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.661068 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.661248 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.661372 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.661565 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.661686 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.661878 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.662000 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.662193 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.662372 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.662493 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.662623 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.662861 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.663051 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.663190 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.663314 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.663443 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.663576 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.663713 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.663850 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.664009 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.664133 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.664317 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.664441 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.664640 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.664775 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.664950 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.665074 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.665301 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.665426 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.665680 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.665815 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.665996 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.666117 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.666309 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.666431 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.666618 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.666791 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.666953 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.667076 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.667264 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.667388 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.667588 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.667727 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.667891 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.668016 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.668202 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.668336 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.668508 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.668644 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.668816 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.668930 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.669125 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.669255 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.669451 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.669575 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.669761 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.669895 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.670069 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.670202 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.670386 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.670510 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.670723 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.670860 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.671048 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.671188 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.671365 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.671489 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.671674 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.672079 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.672299 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.672435 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.672618 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.672746 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.672948 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.673156 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.673310 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.673527 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.673683 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.673847 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.674008 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.674161 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.674323 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.674476 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.674628 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.674800 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.674952 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.675104 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.675267 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.675420 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.675573 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.675736 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.675889 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.676042 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.676202 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.676354 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.676506 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.676660 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.676813 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.676974 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.677125 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.677286 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.677440 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.677613 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.677791 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.677954 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.678118 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.678271 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.678424 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.678577 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.678775 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.678915 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.679038 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.679162 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.679287 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.679410 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.679588 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.679807 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.679927 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.680105 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.680230 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.680353 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.680490 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.680610 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.680736 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.680875 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.680999 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.681179 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.681316 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.681500 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.681625 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.681814 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.681938 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.682130 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.682267 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.682464 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.682613 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.682810 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.682946 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.683112 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.683391 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.683513 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.683656 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.683813 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.683938 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.684131 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.684251 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.684446 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.684574 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.684771 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.684890 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.685095 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.685214 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.685416 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.685533 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.685730 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.685857 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.686063 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.686182 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.686372 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.686497 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.686733 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.686886 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.687057 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.687192 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.687316 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 12:04:01.687473 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.687698 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.688004 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.688320 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.688657 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.688977 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.689303 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.689617 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.689941 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.690253 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.690577 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.690926 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.691296 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.691561 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.691898 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.692216 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.692552 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.692846 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.693159 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.693474 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.693786 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.694112 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.694438 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.694772 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.695102 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.695422 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.695745 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.696066 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.696384 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.696788 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.697106 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.697434 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.697859 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.698211 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.698538 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.698889 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.699224 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.699558 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.699891 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.700223 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.700576 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.700895 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.701245 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.701579 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:04:01.701826 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 12:04:01.711304 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG oslo_db.sqlalchemy.engines [None req-c32417e6-2efc-4a39-920a-3b987d298347 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:04:01.725642 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_db.sqlalchemy.engines [None req-985ec300-b66b-4391-b1b9-95f4fa42499b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100802) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:04:01.887784 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.context [None req-c32417e6-2efc-4a39-920a-3b987d298347 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9fb42506-31a2-4c14-b2b5-bfc6c9f915c9(cell1) {{(pid=100801) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 12:04:01.892770 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG oslo_concurrency.lockutils [None req-c32417e6-2efc-4a39-920a-3b987d298347 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:04:01.894363 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG oslo_concurrency.lockutils [None req-c32417e6-2efc-4a39-920a-3b987d298347 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:04:01.895191 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG oslo_concurrency.lockutils [None req-c32417e6-2efc-4a39-920a-3b987d298347 None None] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:04:01.897110 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG oslo_concurrency.lockutils [None req-c32417e6-2efc-4a39-920a-3b987d298347 None None] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:04:01.901214 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.context [None req-985ec300-b66b-4391-b1b9-95f4fa42499b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9fb42506-31a2-4c14-b2b5-bfc6c9f915c9(cell1) {{(pid=100802) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 12:04:01.905690 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-985ec300-b66b-4391-b1b9-95f4fa42499b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:04:01.907414 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-985ec300-b66b-4391-b1b9-95f4fa42499b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:04:01.907631 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG oslo_db.sqlalchemy.engines [None req-c32417e6-2efc-4a39-920a-3b987d298347 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:04:01.908244 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-985ec300-b66b-4391-b1b9-95f4fa42499b None None] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:04:01.910217 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-985ec300-b66b-4391-b1b9-95f4fa42499b None None] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:04:01.911699 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG oslo_db.sqlalchemy.engines [None req-c32417e6-2efc-4a39-920a-3b987d298347 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:04:01.923746 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_db.sqlalchemy.engines [None req-985ec300-b66b-4391-b1b9-95f4fa42499b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100802) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:04:01.925914 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_db.sqlalchemy.engines [None req-985ec300-b66b-4391-b1b9-95f4fa42499b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100802) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:04:02.178168 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG oslo_db.sqlalchemy.engines [None req-c32417e6-2efc-4a39-920a-3b987d298347 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:04:02.345803 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_db.sqlalchemy.engines [None req-985ec300-b66b-4391-b1b9-95f4fa42499b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100802) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:04:02.527931 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: WARNING keystonemiddleware.auth_token [None req-c32417e6-2efc-4a39-920a-3b987d298347 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:04:02.535056 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: WARNING keystonemiddleware.auth_token [None req-c32417e6-2efc-4a39-920a-3b987d298347 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:04:02.676506 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: WARNING keystonemiddleware.auth_token [None req-985ec300-b66b-4391-b1b9-95f4fa42499b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:04:02.683396 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: WARNING keystonemiddleware.auth_token [None req-985ec300-b66b-4391-b1b9-95f4fa42499b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:04:02.888251 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: WARNING keystonemiddleware.auth_token [None req-c32417e6-2efc-4a39-920a-3b987d298347 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:04:02.894250 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: WARNING keystonemiddleware.auth_token [None req-c32417e6-2efc-4a39-920a-3b987d298347 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:04:02.900910 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f2b2a499c0 pid: 100801 (default app) Oct 28 12:04:02.903230 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-c32417e6-2efc-4a39-920a-3b987d298347 None None] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:04:02.904477 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-c32417e6-2efc-4a39-920a-3b987d298347 None None] 10.222.0.37 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001942 Oct 28 12:04:02.904897 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 1/1] 10.222.0.37 () {50 vars in 788 bytes} [Thu Oct 28 12:04:02 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:04:03.044276 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: WARNING keystonemiddleware.auth_token [None req-985ec300-b66b-4391-b1b9-95f4fa42499b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:04:03.049751 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: WARNING keystonemiddleware.auth_token [None req-985ec300-b66b-4391-b1b9-95f4fa42499b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:04:03.055038 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f2b2a499c0 pid: 100802 (default app) Oct 28 12:05:27.196788 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-c32417e6-2efc-4a39-920a-3b987d298347 None None] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:05:27.197766 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-c32417e6-2efc-4a39-920a-3b987d298347 None None] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Oct 28 12:05:27.198156 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 2/2] 10.222.0.37 () {54 vars in 930 bytes} [Thu Oct 28 12:05:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:05:27.633982 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-a5968fac-fd1f-4ef3-b9a3-c9f9364020e1 admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:05:27.686871 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-a5968fac-fd1f-4ef3-b9a3-c9f9364020e1 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.480459 Oct 28 12:05:27.705246 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 1/3] 10.222.0.37 () {60 vars in 1291 bytes} [Thu Oct 28 12:05:27 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:05:30.057196 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-c32417e6-2efc-4a39-920a-3b987d298347 None None] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:05:30.058202 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-c32417e6-2efc-4a39-920a-3b987d298347 None None] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Oct 28 12:05:30.058649 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 3/4] 10.222.0.37 () {54 vars in 930 bytes} [Thu Oct 28 12:05:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:05:30.159438 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-29f1f968-0f3e-42ef-b218-38f32775cba9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "id": "c1", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:30.198026 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:05:30.198026 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: warnings.warn(msg) Oct 28 12:05:30.234406 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-29f1f968-0f3e-42ef-b218-38f32775cba9 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.167432 Oct 28 12:05:30.235129 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 2/5] 10.222.0.37 () {64 vars in 1282 bytes} [Thu Oct 28 12:05:30 2021] POST /compute/v2.1/flavors => generated 407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:05:30.453968 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-34b95b1a-ecc2-49cd-94fa-f8126e69dcf7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:30.456331 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:05:30.456331 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: warnings.warn(msg) Oct 28 12:05:30.505178 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-34b95b1a-ecc2-49cd-94fa-f8126e69dcf7 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.261593 Oct 28 12:05:30.506022 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 4/6] 10.222.0.37 () {64 vars in 1335 bytes} [Thu Oct 28 12:05:30 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:05:32.892401 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-29f1f968-0f3e-42ef-b218-38f32775cba9 admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:05:32.893420 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-29f1f968-0f3e-42ef-b218-38f32775cba9 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 28 12:05:32.893845 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 3/7] 10.222.0.37 () {54 vars in 930 bytes} [Thu Oct 28 12:05:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:05:33.018988 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-95c440a8-bbd8-4ff5-904c-ba13f6c28311 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "id": "d1"}} {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:33.037305 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:05:33.037305 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: warnings.warn(msg) Oct 28 12:05:33.058328 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-95c440a8-bbd8-4ff5-904c-ba13f6c28311 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.157082 Oct 28 12:05:33.059846 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 5/8] 10.222.0.37 () {64 vars in 1282 bytes} [Thu Oct 28 12:05:32 2021] POST /compute/v2.1/flavors => generated 404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:05:33.073109 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-7e76545a-edd3-416e-99b9-93a39ae04707 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:33.074760 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:05:33.074760 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: warnings.warn(msg) Oct 28 12:05:33.115570 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-7e76545a-edd3-416e-99b9-93a39ae04707 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046436 Oct 28 12:05:33.115762 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 4/9] 10.222.0.37 () {64 vars in 1335 bytes} [Thu Oct 28 12:05:33 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:05:35.448484 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-95c440a8-bbd8-4ff5-904c-ba13f6c28311 admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:05:35.450013 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-95c440a8-bbd8-4ff5-904c-ba13f6c28311 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001984 Oct 28 12:05:35.450956 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 6/10] 10.222.0.37 () {54 vars in 930 bytes} [Thu Oct 28 12:05:35 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:05:35.514757 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-30f17d18-bd2a-4f49-8482-f00154c2c917 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024, "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "vcpus": 1}} {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:35.536719 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-30f17d18-bd2a-4f49-8482-f00154c2c917 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078649 Oct 28 12:05:35.537496 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 5/11] 10.222.0.37 () {64 vars in 1282 bytes} [Thu Oct 28 12:05:35 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:05:35.550175 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-f04f32d1-7da8-4751-b344-cda27f228074 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:35.576176 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-f04f32d1-7da8-4751-b344-cda27f228074 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029717 Oct 28 12:05:35.577047 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 7/12] 10.222.0.37 () {64 vars in 1335 bytes} [Thu Oct 28 12:05:35 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:05:38.020909 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-30f17d18-bd2a-4f49-8482-f00154c2c917 admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:05:38.021938 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-30f17d18-bd2a-4f49-8482-f00154c2c917 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 28 12:05:38.022363 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 6/13] 10.222.0.37 () {54 vars in 930 bytes} [Thu Oct 28 12:05:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:05:38.080280 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-619c897a-04d8-4a9e-bb53-daf8e544d85e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 2048}} {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:38.097819 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-619c897a-04d8-4a9e-bb53-daf8e544d85e admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068686 Oct 28 12:05:38.098362 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 8/14] 10.222.0.37 () {64 vars in 1282 bytes} [Thu Oct 28 12:05:38 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:05:38.110757 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-2764137e-ba1b-4809-9f02-ecfc8b25e818 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:38.135094 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-2764137e-ba1b-4809-9f02-ecfc8b25e818 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028142 Oct 28 12:05:38.135670 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 7/15] 10.222.0.37 () {64 vars in 1335 bytes} [Thu Oct 28 12:05:38 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:05:40.528149 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-619c897a-04d8-4a9e-bb53-daf8e544d85e admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:05:40.529155 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-619c897a-04d8-4a9e-bb53-daf8e544d85e admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 28 12:05:40.529933 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 9/16] 10.222.0.37 () {54 vars in 930 bytes} [Thu Oct 28 12:05:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:05:40.599422 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-fc405267-3523-429d-b572-01489f3a6efc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "disk": 20, "name": "ds4G", "id": "d4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:40.624842 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-fc405267-3523-429d-b572-01489f3a6efc admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087951 Oct 28 12:05:40.625441 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 8/17] 10.222.0.37 () {64 vars in 1282 bytes} [Thu Oct 28 12:05:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:05:40.641174 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-7ed1d84e-6def-4842-bb69-7bb39a316b90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:40.665976 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-7ed1d84e-6def-4842-bb69-7bb39a316b90 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028379 Oct 28 12:05:40.675113 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 10/18] 10.222.0.37 () {64 vars in 1335 bytes} [Thu Oct 28 12:05:40 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:05:43.009895 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-fc405267-3523-429d-b572-01489f3a6efc admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:05:43.010962 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-fc405267-3523-429d-b572-01489f3a6efc admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Oct 28 12:05:43.012058 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 9/19] 10.222.0.37 () {54 vars in 930 bytes} [Thu Oct 28 12:05:43 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:05:43.093788 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-696338be-d5b6-4717-9455-9819cb18d5f3 admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:05:43.116363 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-696338be-d5b6-4717-9455-9819cb18d5f3 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.097224 Oct 28 12:05:43.116903 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 11/20] 10.222.0.37 () {60 vars in 1291 bytes} [Thu Oct 28 12:05:43 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:05:45.508958 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-fc405267-3523-429d-b572-01489f3a6efc admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:05:45.510023 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-fc405267-3523-429d-b572-01489f3a6efc admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Oct 28 12:05:45.510510 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 10/21] 10.222.0.37 () {54 vars in 930 bytes} [Thu Oct 28 12:05:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:05:45.572431 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-e46ad68f-5e1b-402d-8d70-662c91c1f8f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "name": "m1.tiny"}} {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:45.591075 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-e46ad68f-5e1b-402d-8d70-662c91c1f8f9 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073064 Oct 28 12:05:45.591620 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 12/22] 10.222.0.37 () {64 vars in 1282 bytes} [Thu Oct 28 12:05:45 2021] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:05:45.607460 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-a9e9e948-00e5-4dc9-99f9-8c03bd2baf51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:45.639791 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-a9e9e948-00e5-4dc9-99f9-8c03bd2baf51 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038842 Oct 28 12:05:45.640655 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 11/23] 10.222.0.37 () {64 vars in 1332 bytes} [Thu Oct 28 12:05:45 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:05:47.973320 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-e46ad68f-5e1b-402d-8d70-662c91c1f8f9 admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:05:47.974249 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-e46ad68f-5e1b-402d-8d70-662c91c1f8f9 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 28 12:05:47.974653 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 13/24] 10.222.0.37 () {54 vars in 930 bytes} [Thu Oct 28 12:05:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:05:48.038053 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-180043a5-65a8-4794-9f52-58722dbbfb59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:48.057348 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-180043a5-65a8-4794-9f52-58722dbbfb59 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076047 Oct 28 12:05:48.058249 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 12/25] 10.222.0.37 () {64 vars in 1282 bytes} [Thu Oct 28 12:05:47 2021] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:05:48.070873 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-811c7b48-699b-45d6-a215-723ad4b6cbed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:48.094911 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-811c7b48-699b-45d6-a215-723ad4b6cbed admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027740 Oct 28 12:05:48.095473 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 14/26] 10.222.0.37 () {64 vars in 1332 bytes} [Thu Oct 28 12:05:48 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:05:50.442830 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-180043a5-65a8-4794-9f52-58722dbbfb59 admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:05:50.443931 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-180043a5-65a8-4794-9f52-58722dbbfb59 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Oct 28 12:05:50.444418 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 13/27] 10.222.0.37 () {54 vars in 930 bytes} [Thu Oct 28 12:05:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:05:50.503287 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-c901cab1-617c-46e5-9c1a-19f9ac9215ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "vcpus": 2, "swap": 0}} {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:50.520294 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-c901cab1-617c-46e5-9c1a-19f9ac9215ce admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069063 Oct 28 12:05:50.520838 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 15/28] 10.222.0.37 () {64 vars in 1282 bytes} [Thu Oct 28 12:05:50 2021] POST /compute/v2.1/flavors => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:05:50.533743 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-f8fb3563-86e9-4c01-8c1e-0bb667764430 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:50.556368 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-f8fb3563-86e9-4c01-8c1e-0bb667764430 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026203 Oct 28 12:05:50.556936 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 14/29] 10.222.0.37 () {64 vars in 1332 bytes} [Thu Oct 28 12:05:50 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:05:52.898674 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-c901cab1-617c-46e5-9c1a-19f9ac9215ce admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:05:52.899727 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-c901cab1-617c-46e5-9c1a-19f9ac9215ce admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 28 12:05:52.906033 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 16/30] 10.222.0.37 () {54 vars in 930 bytes} [Thu Oct 28 12:05:52 2021] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:05:52.974326 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-e43b43fb-3f29-403d-9693-da5e0e4d15b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 8192, "rxtx_factor": 1.0, "id": "4", "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:52.993444 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-e43b43fb-3f29-403d-9693-da5e0e4d15b9 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.086168 Oct 28 12:05:52.994330 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 15/31] 10.222.0.37 () {64 vars in 1282 bytes} [Thu Oct 28 12:05:52 2021] POST /compute/v2.1/flavors => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:05:53.010630 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-9caafae0-298b-46f1-94b4-ef5fa28d181e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:53.038095 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-9caafae0-298b-46f1-94b4-ef5fa28d181e admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034478 Oct 28 12:05:53.038960 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 17/32] 10.222.0.37 () {64 vars in 1332 bytes} [Thu Oct 28 12:05:53 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:05:55.466631 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-e43b43fb-3f29-403d-9693-da5e0e4d15b9 admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:05:55.467745 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-e43b43fb-3f29-403d-9693-da5e0e4d15b9 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Oct 28 12:05:55.468581 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 16/33] 10.222.0.37 () {54 vars in 930 bytes} [Thu Oct 28 12:05:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:05:55.537725 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-bcda8429-f583-4560-8257-c816c8f2bf83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "id": "5", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:55.558144 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-bcda8429-f583-4560-8257-c816c8f2bf83 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.083152 Oct 28 12:05:55.559332 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 18/34] 10.222.0.37 () {64 vars in 1282 bytes} [Thu Oct 28 12:05:55 2021] POST /compute/v2.1/flavors => generated 408 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:05:55.571702 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-9104a65c-1407-41f9-8fd7-afc51722cfa5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:05:55.602165 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-9104a65c-1407-41f9-8fd7-afc51722cfa5 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034249 Oct 28 12:05:55.603316 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 17/35] 10.222.0.37 () {64 vars in 1332 bytes} [Thu Oct 28 12:05:55 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:06:35.619608 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-bcda8429-f583-4560-8257-c816c8f2bf83 admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:35.620606 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-bcda8429-f583-4560-8257-c816c8f2bf83 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 28 12:06:35.620997 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 19/36] 10.222.0.37 () {54 vars in 930 bytes} [Thu Oct 28 12:06:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:06:35.682087 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-0ce876fa-9aaa-418f-9ecf-e9b78cdc1920 admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:35.700430 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-0ce876fa-9aaa-418f-9ecf-e9b78cdc1920 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072501 Oct 28 12:06:35.700979 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 18/37] 10.222.0.37 () {60 vars in 1291 bytes} [Thu Oct 28 12:06:35 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:06:37.266199 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-bcda8429-f583-4560-8257-c816c8f2bf83 admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:37.267228 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-bcda8429-f583-4560-8257-c816c8f2bf83 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Oct 28 12:06:37.267631 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 20/38] 10.222.0.37 () {56 vars in 1074 bytes} [Thu Oct 28 12:06:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:06:37.463695 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-10dd2349-7353-41b0-96ce-db1a823cb17e admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:37.469154 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.wsgi [None req-10dd2349-7353-41b0-96ce-db1a823cb17e admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 12:06:37.469720 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-10dd2349-7353-41b0-96ce-db1a823cb17e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:06:37.470533 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-10dd2349-7353-41b0-96ce-db1a823cb17e admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060524 Oct 28 12:06:37.471097 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 19/39] 10.222.0.37 () {60 vars in 1190 bytes} [Thu Oct 28 12:06:37 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 12:06:37.489747 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-36ce63a0-0607-4efb-9d69-9b1279ea2805 admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:37.511098 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-36ce63a0-0607-4efb-9d69-9b1279ea2805 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025253 Oct 28 12:06:37.511669 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 21/40] 10.222.0.37 () {60 vars in 1210 bytes} [Thu Oct 28 12:06:37 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:06:37.522216 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-2247b65a-52d2-4c34-9ef8-94cc11e6c94f admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:37.543803 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-2247b65a-52d2-4c34-9ef8-94cc11e6c94f admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025006 Oct 28 12:06:37.544373 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 20/41] 10.222.0.37 () {60 vars in 1210 bytes} [Thu Oct 28 12:06:37 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:06:37.554759 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-690aaf28-8807-4d9d-abf7-6d879a93660e admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:37.561099 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.wsgi [None req-690aaf28-8807-4d9d-abf7-6d879a93660e admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 12:06:37.561665 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-690aaf28-8807-4d9d-abf7-6d879a93660e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:06:37.562468 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-690aaf28-8807-4d9d-abf7-6d879a93660e admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011323 Oct 28 12:06:37.563057 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 22/42] 10.222.0.37 () {60 vars in 1190 bytes} [Thu Oct 28 12:06:37 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 12:06:39.036696 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-2247b65a-52d2-4c34-9ef8-94cc11e6c94f admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:39.037699 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-2247b65a-52d2-4c34-9ef8-94cc11e6c94f admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 28 12:06:39.038096 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 21/43] 10.222.0.37 () {56 vars in 1074 bytes} [Thu Oct 28 12:06:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:06:39.232117 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-113498bd-3111-459a-987c-63b06124bdda admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:39.238069 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.wsgi [None req-113498bd-3111-459a-987c-63b06124bdda admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 12:06:39.238837 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-113498bd-3111-459a-987c-63b06124bdda admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:06:39.239648 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-113498bd-3111-459a-987c-63b06124bdda admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061212 Oct 28 12:06:39.240189 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 23/44] 10.222.0.37 () {60 vars in 1190 bytes} [Thu Oct 28 12:06:39 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 12:06:39.250734 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-2249550c-4554-4452-bccd-d017e818cc91 admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:39.264391 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-2249550c-4554-4452-bccd-d017e818cc91 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017209 Oct 28 12:06:39.265003 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 22/45] 10.222.0.37 () {60 vars in 1210 bytes} [Thu Oct 28 12:06:39 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:06:39.276158 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-d7f1d2c8-fa62-4b4a-b7b5-d658869988fe admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:39.290631 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-d7f1d2c8-fa62-4b4a-b7b5-d658869988fe admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017729 Oct 28 12:06:39.291219 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 24/46] 10.222.0.37 () {60 vars in 1210 bytes} [Thu Oct 28 12:06:39 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:06:39.301689 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-d5206a47-d325-4fe0-a6dd-69d2473dffba admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:39.307173 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.wsgi [None req-d5206a47-d325-4fe0-a6dd-69d2473dffba admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 12:06:39.307740 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-d5206a47-d325-4fe0-a6dd-69d2473dffba admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:06:39.308542 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-d5206a47-d325-4fe0-a6dd-69d2473dffba admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010506 Oct 28 12:06:39.309075 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 23/47] 10.222.0.37 () {60 vars in 1190 bytes} [Thu Oct 28 12:06:39 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 28 12:06:40.759760 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-d7f1d2c8-fa62-4b4a-b7b5-d658869988fe admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:40.760757 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-d7f1d2c8-fa62-4b4a-b7b5-d658869988fe admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Oct 28 12:06:40.761164 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 25/48] 10.222.0.37 () {56 vars in 1074 bytes} [Thu Oct 28 12:06:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:06:40.956719 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-34605e44-fcfe-49a1-9b1d-daf89f84980c admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:40.967174 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.wsgi [None req-34605e44-fcfe-49a1-9b1d-daf89f84980c admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 12:06:40.968060 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-34605e44-fcfe-49a1-9b1d-daf89f84980c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:06:40.969384 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-34605e44-fcfe-49a1-9b1d-daf89f84980c admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.067134 Oct 28 12:06:40.970266 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 24/49] 10.222.0.37 () {60 vars in 1193 bytes} [Thu Oct 28 12:06:40 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 12:06:40.982054 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-39e78e73-9c88-46ec-98f6-7afb35d3dcf9 admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:40.996633 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-39e78e73-9c88-46ec-98f6-7afb35d3dcf9 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018047 Oct 28 12:06:40.997202 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 26/50] 10.222.0.37 () {60 vars in 1210 bytes} [Thu Oct 28 12:06:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:06:41.007756 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-7dfe5326-8b82-47e4-ac73-8b2343ac3f24 admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:41.021761 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-7dfe5326-8b82-47e4-ac73-8b2343ac3f24 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017488 Oct 28 12:06:41.022341 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 25/51] 10.222.0.37 () {60 vars in 1210 bytes} [Thu Oct 28 12:06:41 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:06:41.033840 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-08ad91b3-0dd1-4526-a58c-ba3e374be3fa admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:41.039382 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.wsgi [None req-08ad91b3-0dd1-4526-a58c-ba3e374be3fa admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 12:06:41.040538 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-08ad91b3-0dd1-4526-a58c-ba3e374be3fa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:06:41.041358 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-08ad91b3-0dd1-4526-a58c-ba3e374be3fa admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011159 Oct 28 12:06:41.041939 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 27/52] 10.222.0.37 () {60 vars in 1193 bytes} [Thu Oct 28 12:06:41 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 12:06:42.516998 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-7dfe5326-8b82-47e4-ac73-8b2343ac3f24 admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:42.518029 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-7dfe5326-8b82-47e4-ac73-8b2343ac3f24 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 28 12:06:42.518611 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 26/53] 10.222.0.37 () {56 vars in 1074 bytes} [Thu Oct 28 12:06:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:06:42.717894 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-cef4b95d-3a96-4a69-a30f-abddeca2791b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:06:42.739095 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-cef4b95d-3a96-4a69-a30f-abddeca2791b admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.075087 Oct 28 12:06:42.739647 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 28/54] 10.222.0.37 () {64 vars in 1235 bytes} [Thu Oct 28 12:06:42 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:06:44.181956 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-7dfe5326-8b82-47e4-ac73-8b2343ac3f24 admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:44.182976 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-7dfe5326-8b82-47e4-ac73-8b2343ac3f24 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001395 Oct 28 12:06:44.183369 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 27/55] 10.222.0.37 () {56 vars in 1074 bytes} [Thu Oct 28 12:06:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:06:44.376448 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-12318c15-8384-46a3-9f78-6beaa29f9e00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:06:44.394354 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-12318c15-8384-46a3-9f78-6beaa29f9e00 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.072486 Oct 28 12:06:44.394891 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 29/56] 10.222.0.37 () {64 vars in 1235 bytes} [Thu Oct 28 12:06:44 2021] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:06:45.825820 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-7dfe5326-8b82-47e4-ac73-8b2343ac3f24 admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:45.826853 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-7dfe5326-8b82-47e4-ac73-8b2343ac3f24 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 28 12:06:45.827279 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 28/57] 10.222.0.37 () {56 vars in 1074 bytes} [Thu Oct 28 12:06:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:06:46.019885 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-55e1e273-7ec9-4123-91d5-a778ef754df9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:06:46.038093 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-55e1e273-7ec9-4123-91d5-a778ef754df9 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071293 Oct 28 12:06:46.038634 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 30/58] 10.222.0.37 () {64 vars in 1235 bytes} [Thu Oct 28 12:06:45 2021] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:06:47.465889 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-7dfe5326-8b82-47e4-ac73-8b2343ac3f24 admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:47.466926 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-7dfe5326-8b82-47e4-ac73-8b2343ac3f24 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Oct 28 12:06:47.467334 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 29/59] 10.222.0.37 () {56 vars in 1074 bytes} [Thu Oct 28 12:06:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:06:47.658612 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-9d2b446e-08b9-4391-9886-cb11348a09ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:06:47.676221 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-9d2b446e-08b9-4391-9886-cb11348a09ee admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070248 Oct 28 12:06:47.676699 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 31/60] 10.222.0.37 () {64 vars in 1235 bytes} [Thu Oct 28 12:06:47 2021] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:06:49.113508 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-7dfe5326-8b82-47e4-ac73-8b2343ac3f24 admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:49.114534 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-7dfe5326-8b82-47e4-ac73-8b2343ac3f24 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 28 12:06:49.114978 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 30/61] 10.222.0.37 () {56 vars in 1074 bytes} [Thu Oct 28 12:06:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:06:49.306149 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-46554105-c1da-44f8-ac0f-9c29f9eacfe0 admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:06:49.325870 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-46554105-c1da-44f8-ac0f-9c29f9eacfe0 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072894 Oct 28 12:06:49.326412 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 32/62] 10.222.0.37 () {60 vars in 1202 bytes} [Thu Oct 28 12:06:49 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:07:37.803875 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-7dfe5326-8b82-47e4-ac73-8b2343ac3f24 admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:07:37.804865 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-7dfe5326-8b82-47e4-ac73-8b2343ac3f24 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Oct 28 12:07:37.805320 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 31/63] 10.222.0.37 () {54 vars in 930 bytes} [Thu Oct 28 12:07:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:07:37.863523 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-178890e9-0ee2-4c5a-9db0-176951e3ab54 admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:07:37.883772 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-178890e9-0ee2-4c5a-9db0-176951e3ab54 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071718 Oct 28 12:07:37.884323 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 33/64] 10.222.0.37 () {60 vars in 1291 bytes} [Thu Oct 28 12:07:37 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:07:37.906173 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-8ea1c83a-4264-4c30-b761-f1280b527557 admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:07:37.913734 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-8ea1c83a-4264-4c30-b761-f1280b527557 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011255 Oct 28 12:07:37.914252 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 32/65] 10.222.0.37 () {60 vars in 1282 bytes} [Thu Oct 28 12:07:37 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:07:37.926511 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-19305a3e-fcae-45f6-9b31-60950c0120ac admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:07:37.939874 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-19305a3e-fcae-45f6-9b31-60950c0120ac admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016833 Oct 28 12:07:37.940427 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 34/66] 10.222.0.37 () {60 vars in 1285 bytes} [Thu Oct 28 12:07:37 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:07:37.953025 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-a5eb88b0-4b28-4085-a35e-34811f12fbda admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:07:37.960709 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-a5eb88b0-4b28-4085-a35e-34811f12fbda admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011192 Oct 28 12:07:37.961229 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 33/67] 10.222.0.37 () {60 vars in 1285 bytes} [Thu Oct 28 12:07:37 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:07:37.973091 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-7ff60f18-ef79-4ae0-8160-5be533f34490 admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:07:37.980637 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-7ff60f18-ef79-4ae0-8160-5be533f34490 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011014 Oct 28 12:07:37.981158 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 35/68] 10.222.0.37 () {60 vars in 1282 bytes} [Thu Oct 28 12:07:37 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:08:59.135288 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-a67158c0-1df7-4524-9942-d7fb10e8df42 tempest-verify_tempest_config-1545054860 tempest-verify_tempest_config-1545054860-project] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:08:59.137272 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-a67158c0-1df7-4524-9942-d7fb10e8df42 tempest-verify_tempest_config-1545054860 tempest-verify_tempest_config-1545054860-project] 10.222.0.37 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.115927 Oct 28 12:08:59.137800 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 34/69] 10.222.0.37 () {58 vars in 1133 bytes} [Thu Oct 28 12:08:59 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:10:32.465620 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-7ff60f18-ef79-4ae0-8160-5be533f34490 admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:10:32.466657 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-7ff60f18-ef79-4ae0-8160-5be533f34490 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 28 12:10:32.467191 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 36/70] 10.222.0.37 () {56 vars in 1074 bytes} [Thu Oct 28 12:10:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:10:32.722344 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-a70ba3d9-4d93-48d3-918e-751ba058fee0 admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:10:32.723537 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:10:32.723537 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: warnings.warn(msg) Oct 28 12:10:32.725731 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-a70ba3d9-4d93-48d3-918e-751ba058fee0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:10:32.726366 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-a70ba3d9-4d93-48d3-918e-751ba058fee0 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:10:32.727435 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-a70ba3d9-4d93-48d3-918e-751ba058fee0 admin admin] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:10:32.727856 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-a70ba3d9-4d93-48d3-918e-751ba058fee0 admin admin] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:10:32.760864 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-a70ba3d9-4d93-48d3-918e-751ba058fee0 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.148531 Oct 28 12:10:32.761444 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 35/71] 10.222.0.37 () {60 vars in 1193 bytes} [Thu Oct 28 12:10:32 2021] GET /compute/v2.1/os-services => generated 791 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:10:34.219635 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-7ff60f18-ef79-4ae0-8160-5be533f34490 admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:10:34.220682 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-7ff60f18-ef79-4ae0-8160-5be533f34490 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 28 12:10:34.221097 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 37/72] 10.222.0.37 () {56 vars in 1074 bytes} [Thu Oct 28 12:10:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:10:34.418476 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-6933037c-01d6-4fea-80fe-1394b0661ad6 admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:10:34.419664 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:10:34.419664 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: warnings.warn(msg) Oct 28 12:10:34.421473 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-6933037c-01d6-4fea-80fe-1394b0661ad6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:10:34.421860 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-6933037c-01d6-4fea-80fe-1394b0661ad6 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:10:34.422631 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-6933037c-01d6-4fea-80fe-1394b0661ad6 admin admin] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:10:34.423071 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-6933037c-01d6-4fea-80fe-1394b0661ad6 admin admin] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:10:34.442405 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-6933037c-01d6-4fea-80fe-1394b0661ad6 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079675 Oct 28 12:10:34.443002 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 36/73] 10.222.0.37 () {60 vars in 1193 bytes} [Thu Oct 28 12:10:34 2021] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:10:46.334936 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-7ff60f18-ef79-4ae0-8160-5be533f34490 admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:10:46.335947 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-7ff60f18-ef79-4ae0-8160-5be533f34490 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002135 Oct 28 12:10:46.336353 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 38/74] 10.222.0.37 () {56 vars in 1074 bytes} [Thu Oct 28 12:10:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:10:46.540289 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-033667a2-df53-4f1e-b9cc-692b2bba47b0 admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:10:46.541537 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:10:46.541537 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: warnings.warn(msg) Oct 28 12:10:46.543306 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-033667a2-df53-4f1e-b9cc-692b2bba47b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:10:46.543894 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-033667a2-df53-4f1e-b9cc-692b2bba47b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:10:46.544740 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-033667a2-df53-4f1e-b9cc-692b2bba47b0 admin admin] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:10:46.545263 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-033667a2-df53-4f1e-b9cc-692b2bba47b0 admin admin] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:10:46.571008 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-033667a2-df53-4f1e-b9cc-692b2bba47b0 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.093068 Oct 28 12:10:46.571568 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 37/75] 10.222.0.37 () {60 vars in 1193 bytes} [Thu Oct 28 12:10:46 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:10:48.057749 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: DEBUG nova.api.openstack.wsgi [None req-7ff60f18-ef79-4ae0-8160-5be533f34490 admin admin] Calling method '>' {{(pid=100801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:10:48.058829 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: INFO nova.api.openstack.requestlog [None req-7ff60f18-ef79-4ae0-8160-5be533f34490 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 28 12:10:48.059243 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: [pid: 100801|app: 0|req: 39/76] 10.222.0.37 () {56 vars in 1074 bytes} [Thu Oct 28 12:10:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:10:48.261399 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG nova.api.openstack.wsgi [None req-7d48f5b4-bedd-40a1-8e0e-7279bd8622a1 admin admin] Calling method '>' {{(pid=100802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:10:48.262555 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:10:48.262555 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: warnings.warn(msg) Oct 28 12:10:48.264131 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-7d48f5b4-bedd-40a1-8e0e-7279bd8622a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:10:48.264570 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-7d48f5b4-bedd-40a1-8e0e-7279bd8622a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:10:48.265361 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-7d48f5b4-bedd-40a1-8e0e-7279bd8622a1 admin admin] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:10:48.265784 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: DEBUG oslo_concurrency.lockutils [None req-7d48f5b4-bedd-40a1-8e0e-7279bd8622a1 admin admin] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:10:48.287699 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: INFO nova.api.openstack.requestlog [None req-7d48f5b4-bedd-40a1-8e0e-7279bd8622a1 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081266 Oct 28 12:10:48.288289 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: [pid: 100802|app: 0|req: 38/77] 10.222.0.37 () {60 vars in 1193 bytes} [Thu Oct 28 12:10:48 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:11:46.817352 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: Thu Oct 28 12:11:46 2021 - graceful shutdown triggered... Oct 28 12:11:46.817875 dv-cinder-815712-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 28 12:11:46.818655 dv-cinder-815712-4-iscsi devstack@n-api.service[100802]: Gracefully killing worker 2 (pid: 100802)... Oct 28 12:11:46.819078 dv-cinder-815712-4-iscsi devstack@n-api.service[100801]: Gracefully killing worker 1 (pid: 100801)... Oct 28 12:11:47.819860 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: worker 1 buried after 1 seconds Oct 28 12:11:47.819860 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: worker 2 buried after 1 seconds Oct 28 12:11:47.819860 dv-cinder-815712-4-iscsi devstack@n-api.service[100800]: goodbye to uWSGI. Oct 28 12:11:47.821576 dv-cinder-815712-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 28 12:11:47.822461 dv-cinder-815712-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 28 12:11:47.826786 dv-cinder-815712-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 12:11:47.839211 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 12:11:47.841329 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 28 12:11:47 2021] *** Oct 28 12:11:47.841329 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 12:11:47.841329 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 12:11:47.841329 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: nodename: dv-cinder-815712-4-iscsi Oct 28 12:11:47.841329 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: machine: x86_64 Oct 28 12:11:47.841329 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: clock source: unix Oct 28 12:11:47.841329 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: pcre jit disabled Oct 28 12:11:47.841329 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: detected number of CPU cores: 4 Oct 28 12:11:47.841329 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: current working directory: / Oct 28 12:11:47.841329 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: detected binary path: /usr/bin/uwsgi-core Oct 28 12:11:47.841329 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: your processes number limit is 47680 Oct 28 12:11:47.841329 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: your memory page size is 4096 bytes Oct 28 12:11:47.841329 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: detected max file descriptor number: 2048 Oct 28 12:11:47.841329 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: lock engine: pthread robust mutexes Oct 28 12:11:47.842240 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: thunder lock: enabled Oct 28 12:11:47.842240 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 12:11:47.842240 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 28 12:11:47.889237 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: Python main interpreter initialized at 0x558c3f8859c0 Oct 28 12:11:47.889237 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: python threads support enabled Oct 28 12:11:47.889237 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: your server socket listen backlog is limited to 100 connections Oct 28 12:11:47.889237 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: your mercy for graceful operations on workers is 90 seconds Oct 28 12:11:47.889568 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 12:11:47.889568 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: *** Operational MODE: preforking *** Oct 28 12:11:47.889708 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: *** uWSGI is running in multiple interpreter mode *** Oct 28 12:11:47.889708 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: spawned uWSGI master process (pid: 115783) Oct 28 12:11:47.889919 dv-cinder-815712-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 28 12:11:47.890510 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: spawned uWSGI worker 1 (pid: 115797, cores: 1) Oct 28 12:11:47.890942 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: spawned uWSGI worker 2 (pid: 115798, cores: 1) Oct 28 12:11:47.891101 dv-cinder-815712-4-iscsi devstack@n-api.service[115783]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 12:11:49.715016 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:11:49.715016 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: from cryptography.utils import int_from_bytes Oct 28 12:11:49.715725 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:11:49.715725 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: from cryptography.utils import int_from_bytes Oct 28 12:11:49.779284 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:11:49.779284 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: from cryptography.utils import int_from_bytes Oct 28 12:11:49.779947 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:11:49.779947 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: from cryptography.utils import int_from_bytes Oct 28 12:11:52.289869 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 12:11:52.290435 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 12:11:52.290774 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 12:11:52.290992 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 12:11:52.291239 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 12:11:52.291647 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.291972 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.292291 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.292612 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.292943 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.293256 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.293585 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.293910 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.294243 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.294742 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.295067 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.295393 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815712-4-iscsi {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.295715 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.296024 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.296604 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.296922 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.297227 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.297549 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.297870 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.298382 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.300032 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.300350 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.300661 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.301030 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.301352 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.301663 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.302036 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.302353 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.302709 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.303030 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.303478 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815712-4-iscsi {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.303794 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.304128 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.304609 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.305034 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.305624 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.306178 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.306570 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.307012 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.307322 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.307653 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.307975 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.308482 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.308762 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.309119 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.309436 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.309747 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.310066 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.310374 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.310730 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.310960 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.311271 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.311600 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.311921 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.312248 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.312501 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.312749 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.313066 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.313390 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.313702 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.314009 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.314316 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.314637 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.314963 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.315270 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.315575 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.315881 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.316202 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.316516 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.316837 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.317187 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.318122 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.318915 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.318915 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.319219 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.319561 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.319884 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.320197 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.320520 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.320848 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.321161 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.321474 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.321803 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.322108 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.322446 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.322809 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.323066 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.323545 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.323717 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.324173 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.324486 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.324793 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.325099 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.325405 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.325712 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.326022 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.326329 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.326634 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.326975 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.327283 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.327609 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.327890 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.328196 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.328526 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.328938 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.329147 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.329451 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.329757 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.330063 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.330381 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.330723 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.331017 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.331337 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.331642 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.331944 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.332267 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.332573 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.332879 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.333881 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.334059 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.334505 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.334728 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.335020 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.335299 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.335601 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.335899 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.336203 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.336509 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.336814 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.337544 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.337930 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.338104 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.339438 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.339438 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.339438 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.339438 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.340058 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.340058 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.340354 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.340603 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.340932 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.341246 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.341579 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.341902 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.342223 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.342611 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.342980 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.343295 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.344093 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.344093 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.344412 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.344731 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.345174 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.345385 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.345752 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.346021 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.346338 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.346658 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.347033 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.347367 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.347681 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.348201 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.348551 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.348934 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.349586 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.349586 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.350021 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.350252 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.350504 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.350842 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.351186 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.351501 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.351818 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.352174 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.352571 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.352802 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.353112 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.354731 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.354731 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.354731 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.354731 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.355425 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.355425 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.355724 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.355898 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.357318 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.357318 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.357318 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.357318 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.357318 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.358096 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.358096 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.358427 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.358599 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.358839 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.359156 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.359482 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.359870 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.360089 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.360405 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.360723 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.361038 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.361373 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.361691 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.362009 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.362359 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.362753 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.363011 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.363449 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.363708 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.363952 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.364299 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.364613 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.364934 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.365223 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.365529 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.365839 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.366811 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.366811 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.366811 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.367520 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.367520 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.367973 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.367973 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.368415 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.368647 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.368888 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.369281 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.369713 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.371809 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.371809 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.371809 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.371809 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.371809 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.371809 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.371809 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.373448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.373448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.373448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.373448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.373448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.373448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.375078 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.375078 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.375078 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.375078 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.375078 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.376174 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.376174 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.376174 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.377657 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.377657 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.377657 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.377657 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.377657 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.378811 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.378811 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.378811 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.378811 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.379713 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.379713 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.379713 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.382885 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.382885 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.382885 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.382885 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.382885 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.382885 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.382885 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.382885 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.383427 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.383427 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.383692 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.384156 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.384627 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.385090 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.385567 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.385881 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.386202 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.386517 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.386858 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.387169 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.387685 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.388009 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.388315 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.388622 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.388937 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.389261 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.389574 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.389896 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.390218 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.390521 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.390855 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.391183 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.391467 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 12:11:52.391917 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.392013 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 12:11:52.392105 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.392105 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.392271 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 12:11:52.392366 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.392557 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 12:11:52.392697 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.392796 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 12:11:52.393011 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.393186 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.393315 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.393515 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.393614 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.393841 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.393946 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.394165 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.394264 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.394498 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.394588 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.394852 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.394960 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.395155 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.395256 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.395531 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.396144 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.396434 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.396539 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.396660 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.396762 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.396979 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.397070 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.397309 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815712-4-iscsi {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.397407 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.397616 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.397733 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.397929 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.398034 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.398238 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.398337 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.398545 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.398635 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.398883 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.398973 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.399193 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.399303 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.399497 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.399596 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.399805 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.400059 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.400163 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.400374 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.400685 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.400773 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.401001 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.401090 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.401315 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.401413 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.401632 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.401730 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.401945 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.402041 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.402262 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.402365 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.402571 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.402660 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.402931 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.403033 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.403247 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.403350 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.403552 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.403642 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815712-4-iscsi {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.403864 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.403969 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.404171 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.404261 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.404479 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.404730 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.404818 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.405081 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.405276 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.405368 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.405600 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.405699 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.405922 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.406028 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.406255 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.406344 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.406558 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.406648 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.406918 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.407037 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.407225 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.407328 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.407540 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.407643 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.407828 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.407919 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.408141 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.408253 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.408441 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.408533 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.408764 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.408854 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.409072 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.409175 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.409373 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.409474 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.409680 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.409805 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.410077 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.410204 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.410384 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.410486 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.410715 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.410818 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.411046 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.411201 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.411417 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.411520 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.411804 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.411916 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.412110 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.412226 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.412365 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.412496 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.412731 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.412964 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.413178 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.413336 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.413483 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.413709 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.413865 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.414019 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.414174 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.414321 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.414473 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.414634 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.414804 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.414804 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.415200 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.415360 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.415515 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.415676 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.415824 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.415982 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.416130 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.416283 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.416427 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.416571 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.416825 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.416991 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.417148 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.417339 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.417495 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.418050 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.418307 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.418471 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.418627 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.418830 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.418980 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.419125 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.419272 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.419566 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.419566 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.419852 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.420014 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.420169 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.420326 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.420473 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.420618 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.420764 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.420909 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.421054 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.421464 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.421624 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.421796 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.421796 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.422202 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.422349 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.422506 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.422651 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.422832 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.422987 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.423134 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.423286 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.423441 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.423587 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.423751 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.423897 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.424042 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.424195 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.424349 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.424502 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.424648 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.424793 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.424937 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.425092 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.425245 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.425399 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.425553 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.425716 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.425876 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.426043 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.426197 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.426355 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.426355 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.426654 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.427100 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.427270 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.427432 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.427585 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.427757 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.428079 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.428353 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.428513 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.428677 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.428677 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.428967 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.429125 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.429292 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.429452 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.429724 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.429724 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.430047 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.430213 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.430366 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.430530 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.430702 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.430863 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.431015 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.431188 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.431351 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.431504 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.431657 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.431822 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.431977 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.432241 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.432400 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.432565 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.432732 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.432888 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.433048 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.433208 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.433361 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.433520 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.433759 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.433922 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.434084 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.434237 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.434395 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.434561 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.434770 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.434931 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.435084 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.435236 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.435388 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.435553 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.435711 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.435871 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.436031 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.436191 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.436352 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.436352 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.436664 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.436827 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.436980 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.437225 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.437385 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.437547 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.437707 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.437867 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.438173 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.438173 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.438570 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.438764 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.438924 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.439078 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.439246 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.439246 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.439559 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.439738 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.439994 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.440153 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.440306 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.440465 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.440628 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.440781 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.440934 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.441219 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.441402 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:11:52.441570 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.441734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.441888 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.442049 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.442227 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.443032 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.443194 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.443194 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.443503 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.443655 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.443807 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.443970 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.444148 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.444312 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.444474 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.444627 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.444779 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.444931 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.445103 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.445257 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.445410 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.445564 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.446379 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.446548 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.446734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.446910 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.447082 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.447497 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.447670 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.447834 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.447987 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.448322 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.448493 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.448764 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.448932 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.449098 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.449252 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.449422 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.449584 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.449745 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.449906 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.450200 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.450375 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.450536 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.450732 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.450893 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.451046 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.451215 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.451376 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.451537 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.451708 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.451862 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.452023 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.452176 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.452328 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.452479 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.452630 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.452788 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.452950 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.453110 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.453263 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.453421 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.453677 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.453846 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.454010 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.454171 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.454332 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.454491 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.454491 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.454824 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.454995 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.455157 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.455317 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.455477 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.455637 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.455810 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.455965 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.456118 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.456118 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.456406 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.456567 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.456728 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.456881 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.457033 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.457192 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.457370 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.457602 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.457772 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.457945 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.458817 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.458979 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.459154 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.459361 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.459531 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.459531 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.459822 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.459980 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.460136 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.460400 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.460560 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.460720 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.460903 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.461065 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.461220 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.461385 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.461546 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.461699 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.461860 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.462027 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.462180 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.462345 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.462522 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.462727 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.462887 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.462887 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.463188 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.463354 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.463508 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.463659 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.463811 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.463997 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.464164 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.464325 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.464485 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.464637 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.464796 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.464796 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.465110 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.465264 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.465423 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.465576 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.465728 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.465885 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.466052 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.466218 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.466370 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.466522 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.466690 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.466850 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.467102 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.467257 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.467417 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.467596 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.467829 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.468004 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.468158 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.468309 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.468467 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.468626 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.468937 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.469105 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.469265 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.469436 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.469599 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.469759 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.469919 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.470083 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.470245 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.470417 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.470656 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.470849 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.471003 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.471171 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.471324 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.471483 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.471656 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.471811 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.471976 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.472136 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.472296 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.472448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.472606 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.472759 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.472926 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.473086 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.473238 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.473396 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.473564 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.473747 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.473910 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.474070 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.474231 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.474383 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.474535 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.474713 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.474954 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.475119 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.475280 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.475432 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.475592 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.475764 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.475919 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.476078 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.476230 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.476381 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.476540 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.476702 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.476863 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.477019 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.477212 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.477378 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.477531 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.477701 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.477701 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.478108 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.478268 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.478428 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.478587 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.478804 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.479104 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.479263 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.479415 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.479575 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.479741 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.479909 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.480073 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.480245 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.480405 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.480558 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.480823 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.480984 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.481146 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.481298 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.481458 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.481618 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.481780 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.481940 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.482093 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.482258 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.482411 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.482563 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.482751 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.482919 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.483080 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.483235 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.483386 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.483386 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.483685 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.483844 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.483996 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.484147 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.484311 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.484476 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.484636 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.484789 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.484942 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.485092 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.485391 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.485578 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.485734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.485893 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.486045 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.486196 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.486348 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.486520 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.486708 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.486871 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.487023 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.487185 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.487337 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.487516 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.487681 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.487833 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.488071 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.488238 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.488402 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.488581 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.488745 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.488918 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.489151 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.489404 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.489574 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.489728 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.489887 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.490051 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.490212 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.490393 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.490614 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.490809 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.491076 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.491242 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.491412 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.491575 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.491729 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.491889 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.492044 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.492195 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.492346 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.492506 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.492660 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.492819 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.492979 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.493144 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.493308 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.493471 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.493625 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.493785 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.493945 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.494105 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.494270 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.494423 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.494576 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.494755 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.494918 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.495083 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.495247 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.495409 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.495409 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.495699 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.495852 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.496010 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.496170 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.496323 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.496481 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.496641 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.496793 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.496965 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.497118 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.497276 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.497435 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.497595 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.497755 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.497995 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.498763 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.498878 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.498978 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.499074 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.499167 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.499265 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.499355 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.499655 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.499759 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.499845 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.499926 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.500024 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.500115 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.500206 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.500288 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.500377 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.500474 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.500474 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.500635 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.500716 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.500804 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.500894 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.500990 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.501080 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.501162 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.501249 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.501330 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.501421 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.501512 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.501605 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.501605 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.501763 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.501841 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.501917 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.501995 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.502078 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.502158 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.502239 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.502338 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.502431 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.502513 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.502593 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.502672 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.502806 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.502898 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.502995 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.503087 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.503171 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.503257 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.503346 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.503435 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.503525 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.503607 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.503688 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.503768 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.503848 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.503927 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.503927 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.504099 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.504189 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.504189 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.504354 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.504445 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.504537 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.504619 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.504699 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.504780 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.505624 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.505738 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.505832 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.505915 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.506003 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.506086 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.506163 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.506255 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.506345 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.506427 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.506515 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.506604 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.506729 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.506828 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.506921 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.507004 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.507084 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.507165 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.507255 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.507340 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.507429 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.507510 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.507599 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.507680 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.507798 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.507798 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.507798 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.507798 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.508086 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.508177 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.508267 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.508339 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.508405 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.508492 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.508576 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.508657 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.508746 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.508838 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.508929 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.509011 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.509098 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.509192 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.509282 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.509364 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.509454 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.509544 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.509628 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.509705 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.509794 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.509884 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.509974 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.510057 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.510175 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.510451 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.510544 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.510801 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.510903 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.511085 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.511177 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.511339 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.511465 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.511671 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.511767 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.511983 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.512083 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.512290 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.512390 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.512597 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.512696 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.512909 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.513005 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.513222 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.513323 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.513529 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.513619 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.513844 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.513942 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.514160 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.514383 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.514482 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.514799 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.514920 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.515104 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.515194 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.515420 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.515694 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.515793 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.515879 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.516036 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.516141 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.516356 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.516447 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.516657 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.516747 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.516959 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.517058 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.517275 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.517415 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.517584 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.517670 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.517886 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.517981 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.518193 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.518282 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.518497 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.518594 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.518832 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.518940 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.519140 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.519238 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.519448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.519546 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.519752 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.519842 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.520065 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.520164 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.520394 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.520597 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.521360 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.521469 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.521661 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.521910 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.522224 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.522526 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.522963 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.523262 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.523579 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.523901 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.524216 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.524529 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.524638 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.524845 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.524975 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.525378 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.525475 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.525746 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.525863 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.526127 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.526227 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.526416 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.526510 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.526698 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.526835 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.527032 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.527148 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.527347 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.527471 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.527664 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.527801 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.527992 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.528128 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.528283 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.528445 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.528594 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.528771 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.528903 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.529096 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.529212 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.529413 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.529539 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.529737 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.529848 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.530054 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.530143 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.530386 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.530477 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.530759 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.530851 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.531095 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.531176 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.531408 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.531498 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.531908 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.532008 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.532080 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.532158 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.532312 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.532404 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.532622 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.532853 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.532942 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.533185 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.533290 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.533504 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.533596 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.533828 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.533918 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.534141 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.534241 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.534464 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.534568 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.534807 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.534912 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.535127 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.535218 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.535436 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.535531 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.535744 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.535843 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.536110 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.536201 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.536416 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.536533 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.536730 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.536855 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.537039 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.537137 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.537366 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.537492 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.537698 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.537798 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.538010 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.538100 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.538327 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.538416 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.538644 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.538787 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.539063 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.539152 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.539948 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.540049 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.540136 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.540209 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.540287 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.540374 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.540446 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.540522 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.540601 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.540671 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.540914 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.541020 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.541231 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.541317 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.541542 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.541631 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.541857 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.541938 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.542173 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.542266 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.542483 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.542577 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.543343 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.543478 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.543478 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.543788 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.543917 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.544038 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.544156 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.544274 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.544393 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.544511 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.544621 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.544738 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.544848 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.544956 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.545255 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.545449 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.545449 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.545676 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.545676 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 12:11:52.545892 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.546011 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.546639 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.547008 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.547221 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.547628 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.547857 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.548273 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.548591 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.548908 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.549226 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.549527 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.549836 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.550168 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.550471 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.550918 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.551171 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.551544 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.552242 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.552611 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.553085 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.553663 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.553817 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.554132 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.554760 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.555285 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.555628 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.555943 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.556277 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.556823 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.556941 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.557227 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.557539 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.558031 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.558529 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.559046 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.559548 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.560028 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.560514 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.561016 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.561344 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.561680 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.562109 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.562446 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.562795 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.563134 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.563471 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.563787 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.564115 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.564424 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.564742 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.565055 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.565389 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.565706 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.566030 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.566348 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.567057 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.567439 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.568300 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.568656 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.568973 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.569311 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.569639 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.569971 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.570317 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.570618 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.570982 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.571303 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.571618 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.571930 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.572241 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.572593 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.572910 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.573243 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.573584 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.573922 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.574158 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_db.sqlalchemy.engines [None req-806e8e23-8280-405f-8ac7-a5d84e2a2949 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:11:52.574268 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.574570 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.574926 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.575254 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.575578 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.575903 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.576373 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.576856 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.577338 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.577819 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.578307 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.578812 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.579299 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.579765 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.580230 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.580697 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.581203 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.581670 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.582242 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.583524 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.584028 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.584515 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.584985 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.585516 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.585989 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.586489 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.587006 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.587514 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.587997 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.588485 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.588963 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.589457 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.589935 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.590446 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.590795 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.591283 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.591612 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.592098 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.592419 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.592926 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.593418 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.593727 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.594309 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.594657 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.595015 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.595342 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.595690 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.595991 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.596309 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.596791 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.597289 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.597844 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.598363 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.598923 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.599419 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.600334 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.600880 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.601216 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.601546 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.601873 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.602200 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.602568 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.602925 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.603370 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.603702 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.604030 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.604354 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.604688 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.604996 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.605316 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.605639 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.605957 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.606276 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.606595 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.606953 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.607285 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.607626 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.607957 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.608279 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.608600 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.608921 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.609461 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.609779 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.610121 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.610506 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.610814 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.611139 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.611464 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.611798 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.612115 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.612431 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.612746 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.613062 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.613491 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.613829 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.614149 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.615003 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.615516 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.615837 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.616395 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.616754 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.617144 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.617632 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.617814 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.618096 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.618405 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.618835 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.619152 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.619365 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.619684 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.619974 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.620463 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.620862 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.621098 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.621446 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.621727 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.622045 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.622358 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.622969 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.623180 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.623428 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.623755 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.624075 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.624387 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.624699 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.625003 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.625313 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.625794 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.626106 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.626424 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.626928 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.627103 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.627367 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.627716 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.627994 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.628320 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.629077 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.629077 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.629416 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.629571 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.630602 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.630849 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.631139 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.631426 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.631806 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.633153 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.633153 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.633153 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.633657 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.633917 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.634158 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.634549 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.634809 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.635141 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.635501 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.635775 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.636402 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.636402 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.636732 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.637003 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.637322 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.637684 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.638006 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.638352 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.638785 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.639053 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.639318 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.639617 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.640126 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.640310 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.640550 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.640903 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.641330 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.641497 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.641844 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.642140 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.642552 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.645904 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.645904 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.645904 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.645904 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.645904 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.645904 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.645904 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.645904 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.647496 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.647496 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.647496 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.647496 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.647496 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.647496 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.648435 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.648435 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.648435 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.648892 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.648892 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.649205 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.649494 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.649789 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.650022 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.650395 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.650735 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.650993 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.651330 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.651637 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.651959 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.652282 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.652619 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.652921 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.653238 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.653558 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.654055 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.654363 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.654730 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.655039 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.655367 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.656022 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.656202 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.context [None req-806e8e23-8280-405f-8ac7-a5d84e2a2949 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9fb42506-31a2-4c14-b2b5-bfc6c9f915c9(cell1) {{(pid=115797) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 12:11:52.656399 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.656399 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.656719 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.656949 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.657272 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.657594 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.657912 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.658235 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.658558 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.658928 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.659259 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.659591 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.659920 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.660343 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.660671 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-806e8e23-8280-405f-8ac7-a5d84e2a2949 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:11:52.660860 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.661146 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.661307 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:11:52.661513 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 12:11:52.662268 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-806e8e23-8280-405f-8ac7-a5d84e2a2949 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:11:52.663232 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-806e8e23-8280-405f-8ac7-a5d84e2a2949 None None] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:11:52.665212 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-806e8e23-8280-405f-8ac7-a5d84e2a2949 None None] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:11:52.678721 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_db.sqlalchemy.engines [None req-806e8e23-8280-405f-8ac7-a5d84e2a2949 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:11:52.682157 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_db.sqlalchemy.engines [None req-806e8e23-8280-405f-8ac7-a5d84e2a2949 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:11:52.688010 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_db.sqlalchemy.engines [None req-83f6dda7-b760-481f-b3a1-78f5757df556 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:11:52.769633 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.context [None req-83f6dda7-b760-481f-b3a1-78f5757df556 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9fb42506-31a2-4c14-b2b5-bfc6c9f915c9(cell1) {{(pid=115798) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 12:11:52.773808 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-83f6dda7-b760-481f-b3a1-78f5757df556 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:11:52.775564 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-83f6dda7-b760-481f-b3a1-78f5757df556 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:11:52.776413 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-83f6dda7-b760-481f-b3a1-78f5757df556 None None] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:11:52.778542 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-83f6dda7-b760-481f-b3a1-78f5757df556 None None] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:11:52.789528 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_db.sqlalchemy.engines [None req-83f6dda7-b760-481f-b3a1-78f5757df556 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:11:52.790475 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_db.sqlalchemy.engines [None req-83f6dda7-b760-481f-b3a1-78f5757df556 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:11:52.945508 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_db.sqlalchemy.engines [None req-806e8e23-8280-405f-8ac7-a5d84e2a2949 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:11:53.053160 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_db.sqlalchemy.engines [None req-83f6dda7-b760-481f-b3a1-78f5757df556 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 12:11:53.276406 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: WARNING keystonemiddleware.auth_token [None req-806e8e23-8280-405f-8ac7-a5d84e2a2949 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:11:53.283149 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: WARNING keystonemiddleware.auth_token [None req-806e8e23-8280-405f-8ac7-a5d84e2a2949 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:11:53.383737 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: WARNING keystonemiddleware.auth_token [None req-83f6dda7-b760-481f-b3a1-78f5757df556 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:11:53.390393 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: WARNING keystonemiddleware.auth_token [None req-83f6dda7-b760-481f-b3a1-78f5757df556 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:11:53.633647 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: WARNING keystonemiddleware.auth_token [None req-806e8e23-8280-405f-8ac7-a5d84e2a2949 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:11:53.639142 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: WARNING keystonemiddleware.auth_token [None req-806e8e23-8280-405f-8ac7-a5d84e2a2949 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:11:53.644253 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558c3f8859c0 pid: 115797 (default app) Oct 28 12:11:53.743761 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: WARNING keystonemiddleware.auth_token [None req-83f6dda7-b760-481f-b3a1-78f5757df556 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:11:53.749154 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: WARNING keystonemiddleware.auth_token [None req-83f6dda7-b760-481f-b3a1-78f5757df556 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:11:53.754436 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558c3f8859c0 pid: 115798 (default app) Oct 28 12:12:28.509937 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e545ef75-7c26-45e6-aab7-315f1dbaaeee tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] Action: 'create', calling method: .version_select at 0x7f11f8d68f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-771983733", "metadata": {"Type": "work"}}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:12:28.515092 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e545ef75-7c26-45e6-aab7-315f1dbaaeee tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:12:28.518421 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e545ef75-7c26-45e6-aab7-315f1dbaaeee tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.594313 Oct 28 12:12:28.525066 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 1/1] 10.222.0.37 () {60 vars in 1155 bytes} [Thu Oct 28 12:12:26 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1602 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 12:12:28.806137 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-561edb6f-3607-49ba-b965-9cc64660fb1e tempest-VolumesGetTestJSON-1669988363 tempest-VolumesGetTestJSON-1669988363-project] Action: 'create', calling method: .version_select at 0x7f11f8d92af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1524472736", "metadata": {"Type": "work"}}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:12:28.840749 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0d2689e3-fa1c-42a9-bc67-7442af92391f tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Action: 'create', calling method: .version_select at 0x7f11f8d68f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-4053817"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:12:30.186981 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0d2689e3-fa1c-42a9-bc67-7442af92391f tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 200 len: 342 microversion: 2.1 time: 2.630456 Oct 28 12:12:30.187627 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 1/2] 10.222.0.37 () {60 vars in 1154 bytes} [Thu Oct 28 12:12:27 2021] POST /compute/v2.1/os-volumes => generated 342 bytes in 2633 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 28 12:12:30.192734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b43f4713-517d-42e5-88ac-5e15b3c52f5b tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] Action: 'create', calling method: .version_select at 0x7f11f8d97af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1678507304", "metadata": {"Type": "work"}}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:12:30.194227 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b43f4713-517d-42e5-88ac-5e15b3c52f5b tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:12:30.200867 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b43f4713-517d-42e5-88ac-5e15b3c52f5b tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012280 Oct 28 12:12:30.201724 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 2/3] 10.222.0.37 () {60 vars in 1155 bytes} [Thu Oct 28 12:12:30 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 12:12:30.208851 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-561edb6f-3607-49ba-b965-9cc64660fb1e tempest-VolumesGetTestJSON-1669988363 tempest-VolumesGetTestJSON-1669988363-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.682077 Oct 28 12:12:30.224074 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 2/4] 10.222.0.37 () {60 vars in 1155 bytes} [Thu Oct 28 12:12:28 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 1698 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 28 12:12:30.405642 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ca928189-5107-44dc-a6e6-8be7250401a2 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1844554366", "imageRef": "4385a199-a3e9-4c11-b580-60e7a24d0e97", "flavorRef": "452", "networks": [{"uuid": "6ac1954e-751a-4deb-8186-0c01c33f38fa"}]}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:12:30.467109 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-64609f32-2783-4133-88f7-45a3228f9698 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1202882104", "imageRef": "4385a199-a3e9-4c11-b580-60e7a24d0e97", "flavorRef": "452", "networks": [{"uuid": "6473d7e8-f419-4ba9-aecd-de2094cc6dd8"}]}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:12:30.617389 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-ca928189-5107-44dc-a6e6-8be7250401a2 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] validate_networks() for [('6ac1954e-751a-4deb-8186-0c01c33f38fa', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:12:30.658933 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-64609f32-2783-4133-88f7-45a3228f9698 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] validate_networks() for [('6473d7e8-f419-4ba9-aecd-de2094cc6dd8', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:12:31.435857 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-ca928189-5107-44dc-a6e6-8be7250401a2 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:12:31.436404 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-ca928189-5107-44dc-a6e6-8be7250401a2 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:12:31.436769 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-ca928189-5107-44dc-a6e6-8be7250401a2 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:12:31.437170 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-ca928189-5107-44dc-a6e6-8be7250401a2 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:12:31.437726 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-ca928189-5107-44dc-a6e6-8be7250401a2 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:12:31.451492 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ca928189-5107-44dc-a6e6-8be7250401a2 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:31.451917 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ca928189-5107-44dc-a6e6-8be7250401a2 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:31.452725 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ca928189-5107-44dc-a6e6-8be7250401a2 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:31.453134 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ca928189-5107-44dc-a6e6-8be7250401a2 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:31.486948 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-ca928189-5107-44dc-a6e6-8be7250401a2 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Getting quotas for project 03ac030a59d7441d958e8657b702b9cd. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:12:31.493840 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-ca928189-5107-44dc-a6e6-8be7250401a2 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Getting quotas for user 3b74576b5fc34bd9b851e009a5de3f53 and project 03ac030a59d7441d958e8657b702b9cd. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:12:31.506061 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ca928189-5107-44dc-a6e6-8be7250401a2 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:12:31.509077 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ca928189-5107-44dc-a6e6-8be7250401a2 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4385a199-a3e9-4c11-b580-60e7a24d0e97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:12:31.590835 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ca928189-5107-44dc-a6e6-8be7250401a2 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.387934 Oct 28 12:12:31.591477 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 3/5] 10.222.0.37 () {60 vars in 1146 bytes} [Thu Oct 28 12:12:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 1389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:12:31.602392 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f130ddd4-e3db-4d8b-9276-e3b8ff3a1586 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f8b62280>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:31.673568 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f130ddd4-e3db-4d8b-9276-e3b8ff3a1586 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/700a7917-e7e9-482d-b6d3-feb3e436f3f3" status: 200 len: 342 microversion: 2.1 time: 0.080613 Oct 28 12:12:31.674146 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 4/6] 10.222.0.37 () {58 vars in 1244 bytes} [Thu Oct 28 12:12:31 2021] GET /compute/v2.1/os-volumes/700a7917-e7e9-482d-b6d3-feb3e436f3f3 => generated 342 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:12:31.680759 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-20804b9c-6973-4a02-9f74-a2d12b63b71c tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] Action: 'create', calling method: .version_select at 0x7f11f8b62430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-37743148", "metadata": {"Type": "work"}}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:12:31.682030 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-20804b9c-6973-4a02-9f74-a2d12b63b71c tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:12:31.683889 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-20804b9c-6973-4a02-9f74-a2d12b63b71c tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007764 Oct 28 12:12:31.683889 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 5/7] 10.222.0.37 () {60 vars in 1155 bytes} [Thu Oct 28 12:12:31 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 12:12:31.700227 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dc73c1c7-6ba0-46fd-b62b-5b984545079d tempest-VolumesGetTestJSON-1669988363 tempest-VolumesGetTestJSON-1669988363-project] Calling method '.version_select at 0x7f11f8b62e50>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:31.756492 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dc73c1c7-6ba0-46fd-b62b-5b984545079d tempest-VolumesGetTestJSON-1669988363 tempest-VolumesGetTestJSON-1669988363-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/8dfc12f5-920f-4024-ad50-02eb39dd788f" status: 200 len: 353 microversion: 2.1 time: 0.060340 Oct 28 12:12:31.757165 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 6/8] 10.222.0.37 () {58 vars in 1244 bytes} [Thu Oct 28 12:12:31 2021] GET /compute/v2.1/os-volumes/8dfc12f5-920f-4024-ad50-02eb39dd788f => generated 353 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:12:31.762075 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9ff6f527-3e9b-4f1d-8b22-39c5263a3fc9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:31.763346 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9ff6f527-3e9b-4f1d-8b22-39c5263a3fc9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:31.887180 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9ff6f527-3e9b-4f1d-8b22-39c5263a3fc9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:31.907353 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9ff6f527-3e9b-4f1d-8b22-39c5263a3fc9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1215 microversion: 2.1 time: 0.148884 Oct 28 12:12:31.913229 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 7/9] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:31 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1215 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:31.928902 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-64609f32-2783-4133-88f7-45a3228f9698 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:12:31.930313 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-64609f32-2783-4133-88f7-45a3228f9698 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:12:31.931067 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-64609f32-2783-4133-88f7-45a3228f9698 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:12:31.931328 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4666c03d-5c72-4d69-b268-7185c93838e4 tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] Calling method '.version_select at 0x7f11f8312160>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:31.932184 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-64609f32-2783-4133-88f7-45a3228f9698 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:12:31.934101 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-64609f32-2783-4133-88f7-45a3228f9698 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:12:31.975326 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-64609f32-2783-4133-88f7-45a3228f9698 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:31.978540 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-64609f32-2783-4133-88f7-45a3228f9698 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:31.980052 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-64609f32-2783-4133-88f7-45a3228f9698 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:31.981192 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-64609f32-2783-4133-88f7-45a3228f9698 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:31.985750 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-4666c03d-5c72-4d69-b268-7185c93838e4 tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] HTTP exception thrown: Volume tempest-invalid-597240697 could not be found. Oct 28 12:12:31.987409 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4666c03d-5c72-4d69-b268-7185c93838e4 tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] Returning 404 to user: Volume tempest-invalid-597240697 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:12:31.989574 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4666c03d-5c72-4d69-b268-7185c93838e4 tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/tempest-invalid-597240697" status: 404 len: 98 microversion: 2.1 time: 0.074774 Oct 28 12:12:31.990851 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 8/10] 10.222.0.37 () {58 vars in 1214 bytes} [Thu Oct 28 12:12:31 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-597240697 => generated 98 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 12:12:32.005392 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e302210f-ce4b-4fbd-8e2f-f9cefd40a631 tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009276 Oct 28 12:12:32.006628 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 9/11] 10.222.0.37 () {58 vars in 1139 bytes} [Thu Oct 28 12:12:31 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 12:12:32.015976 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ee80fdab-dc50-4947-ae95-32dd25a4c098 tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004615 Oct 28 12:12:32.017630 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 10/12] 10.222.0.37 () {58 vars in 1136 bytes} [Thu Oct 28 12:12:32 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 12:12:32.032566 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-163b2915-ee3b-47b4-ad23-ba1ab9b55ad0 tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] Calling method '.version_select at 0x7f11f8b623a0>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:32.059706 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-64609f32-2783-4133-88f7-45a3228f9698 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Getting quotas for project f032353009b64d738b6c00574846cb51. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:12:32.068426 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-64609f32-2783-4133-88f7-45a3228f9698 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Getting quotas for user 27f6b74ea1274a9bba153118ccf63571 and project f032353009b64d738b6c00574846cb51. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:12:32.080848 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-64609f32-2783-4133-88f7-45a3228f9698 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:12:32.084260 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-64609f32-2783-4133-88f7-45a3228f9698 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4385a199-a3e9-4c11-b580-60e7a24d0e97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:12:32.107556 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-163b2915-ee3b-47b4-ad23-ba1ab9b55ad0 tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] HTTP exception thrown: Volume 8c2e78ba-fc50-4202-9e85-79739f39e488 could not be found. Oct 28 12:12:32.108259 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-163b2915-ee3b-47b4-ad23-ba1ab9b55ad0 tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] Returning 404 to user: Volume 8c2e78ba-fc50-4202-9e85-79739f39e488 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:12:32.110402 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-163b2915-ee3b-47b4-ad23-ba1ab9b55ad0 tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/8c2e78ba-fc50-4202-9e85-79739f39e488" status: 404 len: 109 microversion: 2.1 time: 0.086313 Oct 28 12:12:32.112263 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 11/13] 10.222.0.37 () {58 vars in 1247 bytes} [Thu Oct 28 12:12:32 2021] DELETE /compute/v2.1/os-volumes/8c2e78ba-fc50-4202-9e85-79739f39e488 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:12:32.130497 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-044291c2-1bb6-4dba-ab7d-d7eca16241ee tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] Calling method '.version_select at 0x7f11f8312f70>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:32.201164 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-044291c2-1bb6-4dba-ab7d-d7eca16241ee tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] HTTP exception thrown: Volume ec0e8483-c983-4a7d-a7cd-918346bf79bb could not be found. Oct 28 12:12:32.202799 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-044291c2-1bb6-4dba-ab7d-d7eca16241ee tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] Returning 404 to user: Volume ec0e8483-c983-4a7d-a7cd-918346bf79bb could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:12:32.209913 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-044291c2-1bb6-4dba-ab7d-d7eca16241ee tempest-VolumesNegativeTest-896717223 tempest-VolumesNegativeTest-896717223-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/ec0e8483-c983-4a7d-a7cd-918346bf79bb" status: 404 len: 109 microversion: 2.1 time: 0.084499 Oct 28 12:12:32.210591 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 12/14] 10.222.0.37 () {58 vars in 1244 bytes} [Thu Oct 28 12:12:32 2021] GET /compute/v2.1/os-volumes/ec0e8483-c983-4a7d-a7cd-918346bf79bb => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:12:32.218975 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-64609f32-2783-4133-88f7-45a3228f9698 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.990638 Oct 28 12:12:32.219299 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 3/15] 10.222.0.37 () {60 vars in 1146 bytes} [Thu Oct 28 12:12:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 1994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:12:32.229745 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-816947ff-aa39-4771-8c53-5d94e91f1068 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:32.230257 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-816947ff-aa39-4771-8c53-5d94e91f1068 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:32.330779 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-816947ff-aa39-4771-8c53-5d94e91f1068 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:32.341362 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-816947ff-aa39-4771-8c53-5d94e91f1068 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1218 microversion: 2.1 time: 0.115527 Oct 28 12:12:32.343706 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 13/16] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:32 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:32.687401 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-dd493e19-1031-4a05-99b7-cc9d9ea4637e tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f8b5f280>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:32.772309 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d6f2c341-dd94-4add-b70f-9b398b816670 tempest-VolumesGetTestJSON-1669988363 tempest-VolumesGetTestJSON-1669988363-project] Calling method '.version_select at 0x7f11f82fcf70>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:32.833198 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-dd493e19-1031-4a05-99b7-cc9d9ea4637e tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/700a7917-e7e9-482d-b6d3-feb3e436f3f3" status: 200 len: 343 microversion: 2.1 time: 0.150064 Oct 28 12:12:32.833889 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 4/17] 10.222.0.37 () {58 vars in 1244 bytes} [Thu Oct 28 12:12:32 2021] GET /compute/v2.1/os-volumes/700a7917-e7e9-482d-b6d3-feb3e436f3f3 => generated 343 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:12:32.848469 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-417dfe25-36bc-4896-bdb4-840bb68c32e5 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Action: 'create', calling method: .version_select at 0x7f11f8b5f430>, body: {"snapshot": {"volume_id": "700a7917-e7e9-482d-b6d3-feb3e436f3f3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-538391874"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:12:32.904316 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d6f2c341-dd94-4add-b70f-9b398b816670 tempest-VolumesGetTestJSON-1669988363 tempest-VolumesGetTestJSON-1669988363-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/8dfc12f5-920f-4024-ad50-02eb39dd788f" status: 200 len: 354 microversion: 2.1 time: 0.138305 Oct 28 12:12:32.914843 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 14/18] 10.222.0.37 () {58 vars in 1244 bytes} [Thu Oct 28 12:12:32 2021] GET /compute/v2.1/os-volumes/8dfc12f5-920f-4024-ad50-02eb39dd788f => generated 354 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:12:32.920141 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-09be6f9e-202a-4d5c-a153-f80c7650d963 tempest-VolumesGetTestJSON-1669988363 tempest-VolumesGetTestJSON-1669988363-project] Calling method '.version_select at 0x7f11f82bb160>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:33.036865 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-09be6f9e-202a-4d5c-a153-f80c7650d963 tempest-VolumesGetTestJSON-1669988363 tempest-VolumesGetTestJSON-1669988363-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/8dfc12f5-920f-4024-ad50-02eb39dd788f" status: 200 len: 354 microversion: 2.1 time: 0.120846 Oct 28 12:12:33.039408 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 15/19] 10.222.0.37 () {58 vars in 1244 bytes} [Thu Oct 28 12:12:32 2021] GET /compute/v2.1/os-volumes/8dfc12f5-920f-4024-ad50-02eb39dd788f => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:12:33.046158 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dd0659ec-f08a-4c9f-a683-3ecef95fd7e6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:33.047331 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dd0659ec-f08a-4c9f-a683-3ecef95fd7e6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:33.177276 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-dd0659ec-f08a-4c9f-a683-3ecef95fd7e6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:33.184949 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dd0659ec-f08a-4c9f-a683-3ecef95fd7e6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1215 microversion: 2.1 time: 0.144264 Oct 28 12:12:33.189283 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 16/20] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:33 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1215 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:33.197791 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d491f1cd-fe3b-43ef-99fc-88a6248b4015 tempest-VolumesGetTestJSON-1669988363 tempest-VolumesGetTestJSON-1669988363-project] Calling method '.version_select at 0x7f11f82b11f0>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:33.333929 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d491f1cd-fe3b-43ef-99fc-88a6248b4015 tempest-VolumesGetTestJSON-1669988363 tempest-VolumesGetTestJSON-1669988363-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/8dfc12f5-920f-4024-ad50-02eb39dd788f" status: 202 len: 0 microversion: 2.1 time: 0.140747 Oct 28 12:12:33.335108 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 17/21] 10.222.0.37 () {58 vars in 1247 bytes} [Thu Oct 28 12:12:33 2021] DELETE /compute/v2.1/os-volumes/8dfc12f5-920f-4024-ad50-02eb39dd788f => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:12:33.345090 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c9ccb8dc-3822-47f0-8a05-084a950c8d24 tempest-VolumesGetTestJSON-1669988363 tempest-VolumesGetTestJSON-1669988363-project] Calling method '.version_select at 0x7f11f82b15e0>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:33.382024 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-417dfe25-36bc-4896-bdb4-840bb68c32e5 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.538481 Oct 28 12:12:33.383651 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 5/22] 10.222.0.37 () {60 vars in 1161 bytes} [Thu Oct 28 12:12:32 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:12:33.393408 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9568b875-6e9a-412d-b451-196d8239e371 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:33.394543 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9568b875-6e9a-412d-b451-196d8239e371 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:33.512575 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c9ccb8dc-3822-47f0-8a05-084a950c8d24 tempest-VolumesGetTestJSON-1669988363 tempest-VolumesGetTestJSON-1669988363-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/8dfc12f5-920f-4024-ad50-02eb39dd788f" status: 200 len: 353 microversion: 2.1 time: 0.172382 Oct 28 12:12:33.513658 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 18/23] 10.222.0.37 () {58 vars in 1244 bytes} [Thu Oct 28 12:12:33 2021] GET /compute/v2.1/os-volumes/8dfc12f5-920f-4024-ad50-02eb39dd788f => generated 353 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:12:33.520495 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a1a611e1-236b-45c4-93ab-c11cc0f75b38 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f8c58310>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:33.573278 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a1a611e1-236b-45c4-93ab-c11cc0f75b38 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529" status: 200 len: 286 microversion: 2.1 time: 0.058517 Oct 28 12:12:33.574049 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 19/24] 10.222.0.37 () {58 vars in 1250 bytes} [Thu Oct 28 12:12:33 2021] GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:12:33.585680 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9e9bf271-3d34-4a13-a429-3e6da12d0e0f tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f8312ca0>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:33.700587 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9e9bf271-3d34-4a13-a429-3e6da12d0e0f tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.119612 Oct 28 12:12:33.701466 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 20/25] 10.222.0.37 () {58 vars in 1139 bytes} [Thu Oct 28 12:12:33 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:12:33.712049 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-40ab04d6-f934-4d38-a619-356874ef9cf0 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f82b1790>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:33.790150 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-40ab04d6-f934-4d38-a619-356874ef9cf0 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529" status: 200 len: 286 microversion: 2.1 time: 0.081884 Oct 28 12:12:33.795103 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 21/26] 10.222.0.37 () {58 vars in 1250 bytes} [Thu Oct 28 12:12:33 2021] GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:12:33.859098 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9568b875-6e9a-412d-b451-196d8239e371 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:33.886419 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9568b875-6e9a-412d-b451-196d8239e371 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1218 microversion: 2.1 time: 0.501583 Oct 28 12:12:33.887186 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 6/27] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:33 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1218 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:34.206889 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-da0e23af-072c-405c-a9b8-50023930aa81 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:34.207612 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-da0e23af-072c-405c-a9b8-50023930aa81 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:34.215946 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da0e23af-072c-405c-a9b8-50023930aa81 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:34.221300 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da0e23af-072c-405c-a9b8-50023930aa81 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:34.224082 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da0e23af-072c-405c-a9b8-50023930aa81 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:34.224820 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da0e23af-072c-405c-a9b8-50023930aa81 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:34.533293 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9095aed2-9943-4c54-8489-8690ff476e57 tempest-VolumesGetTestJSON-1669988363 tempest-VolumesGetTestJSON-1669988363-project] Calling method '.version_select at 0x7f11f8d92820>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:34.586226 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-9095aed2-9943-4c54-8489-8690ff476e57 tempest-VolumesGetTestJSON-1669988363 tempest-VolumesGetTestJSON-1669988363-project] HTTP exception thrown: Volume 8dfc12f5-920f-4024-ad50-02eb39dd788f could not be found. Oct 28 12:12:34.587080 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9095aed2-9943-4c54-8489-8690ff476e57 tempest-VolumesGetTestJSON-1669988363 tempest-VolumesGetTestJSON-1669988363-project] Returning 404 to user: Volume 8dfc12f5-920f-4024-ad50-02eb39dd788f could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:12:34.588242 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9095aed2-9943-4c54-8489-8690ff476e57 tempest-VolumesGetTestJSON-1669988363 tempest-VolumesGetTestJSON-1669988363-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/8dfc12f5-920f-4024-ad50-02eb39dd788f" status: 404 len: 109 microversion: 2.1 time: 0.065930 Oct 28 12:12:34.589255 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 7/28] 10.222.0.37 () {58 vars in 1244 bytes} [Thu Oct 28 12:12:34 2021] GET /compute/v2.1/os-volumes/8dfc12f5-920f-4024-ad50-02eb39dd788f => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:12:34.804252 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6f990497-faf7-439f-9087-01286683eb18 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f8311ee0>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:34.822057 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-da0e23af-072c-405c-a9b8-50023930aa81 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:34.860410 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-da0e23af-072c-405c-a9b8-50023930aa81 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1267 microversion: 2.1 time: 0.657225 Oct 28 12:12:34.864092 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 22/29] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:34 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1267 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:34.905153 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-353f7bd5-567c-4398-b443-e9a17d74ca38 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:34.906866 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-353f7bd5-567c-4398-b443-e9a17d74ca38 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:34.935217 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-353f7bd5-567c-4398-b443-e9a17d74ca38 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:34.935674 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-353f7bd5-567c-4398-b443-e9a17d74ca38 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:34.939372 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-353f7bd5-567c-4398-b443-e9a17d74ca38 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:34.939789 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-353f7bd5-567c-4398-b443-e9a17d74ca38 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:35.015859 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6f990497-faf7-439f-9087-01286683eb18 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529" status: 200 len: 286 microversion: 2.1 time: 0.217096 Oct 28 12:12:35.016778 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 8/30] 10.222.0.37 () {58 vars in 1250 bytes} [Thu Oct 28 12:12:34 2021] GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529 => generated 286 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:12:35.245900 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-353f7bd5-567c-4398-b443-e9a17d74ca38 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:35.265327 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-353f7bd5-567c-4398-b443-e9a17d74ca38 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1222 microversion: 2.1 time: 0.364299 Oct 28 12:12:35.280137 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 23/31] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:34 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1222 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:12:35.879690 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e2afa8f9-37e1-4d0d-8cc0-daaeb1a5a991 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:35.881000 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e2afa8f9-37e1-4d0d-8cc0-daaeb1a5a991 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:35.891725 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e2afa8f9-37e1-4d0d-8cc0-daaeb1a5a991 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:35.892451 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e2afa8f9-37e1-4d0d-8cc0-daaeb1a5a991 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:35.893816 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e2afa8f9-37e1-4d0d-8cc0-daaeb1a5a991 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:35.894456 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e2afa8f9-37e1-4d0d-8cc0-daaeb1a5a991 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:36.030129 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b954ddb2-8cf5-474d-bb03-b73852839e1e tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f8253430>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:36.093663 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b954ddb2-8cf5-474d-bb03-b73852839e1e tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529" status: 200 len: 286 microversion: 2.1 time: 0.068035 Oct 28 12:12:36.099393 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 24/32] 10.222.0.37 () {58 vars in 1250 bytes} [Thu Oct 28 12:12:36 2021] GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:12:36.287095 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0ab4acbc-1956-4d78-8f59-3c1116ff96d3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:36.293535 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0ab4acbc-1956-4d78-8f59-3c1116ff96d3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:36.299665 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0ab4acbc-1956-4d78-8f59-3c1116ff96d3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:36.300017 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0ab4acbc-1956-4d78-8f59-3c1116ff96d3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:36.303908 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0ab4acbc-1956-4d78-8f59-3c1116ff96d3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:36.304502 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0ab4acbc-1956-4d78-8f59-3c1116ff96d3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:36.313207 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e2afa8f9-37e1-4d0d-8cc0-daaeb1a5a991 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:36.349851 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e2afa8f9-37e1-4d0d-8cc0-daaeb1a5a991 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1267 microversion: 2.1 time: 0.473298 Oct 28 12:12:36.351047 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 9/33] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:35 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1267 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:36.482154 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0ab4acbc-1956-4d78-8f59-3c1116ff96d3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:36.492257 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0ab4acbc-1956-4d78-8f59-3c1116ff96d3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1222 microversion: 2.1 time: 0.208691 Oct 28 12:12:36.493186 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 25/34] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:36 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1222 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:12:37.111495 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-df2ec160-b46f-44ed-a372-9716ac56fcd2 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f824f670>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:37.178656 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-df2ec160-b46f-44ed-a372-9716ac56fcd2 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529" status: 200 len: 286 microversion: 2.1 time: 0.071726 Oct 28 12:12:37.182893 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 10/35] 10.222.0.37 () {58 vars in 1250 bytes} [Thu Oct 28 12:12:37 2021] GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:12:37.369806 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9b273c4e-5c2e-4668-aeed-7beb025b85cb tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:37.371079 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9b273c4e-5c2e-4668-aeed-7beb025b85cb tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:37.379263 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9b273c4e-5c2e-4668-aeed-7beb025b85cb tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:37.383855 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9b273c4e-5c2e-4668-aeed-7beb025b85cb tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:37.385055 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9b273c4e-5c2e-4668-aeed-7beb025b85cb tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:37.385498 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9b273c4e-5c2e-4668-aeed-7beb025b85cb tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:37.509614 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9916b088-8ccd-4ea5-a9ed-e9e306ff4afa tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:37.510656 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9916b088-8ccd-4ea5-a9ed-e9e306ff4afa tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:37.519582 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9916b088-8ccd-4ea5-a9ed-e9e306ff4afa tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:37.520333 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9916b088-8ccd-4ea5-a9ed-e9e306ff4afa tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:37.521348 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9916b088-8ccd-4ea5-a9ed-e9e306ff4afa tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:37.521965 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9916b088-8ccd-4ea5-a9ed-e9e306ff4afa tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:37.640604 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9b273c4e-5c2e-4668-aeed-7beb025b85cb tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:37.662266 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9b273c4e-5c2e-4668-aeed-7beb025b85cb tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1267 microversion: 2.1 time: 0.294697 Oct 28 12:12:37.670785 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 26/36] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:37 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1267 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:37.747674 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9916b088-8ccd-4ea5-a9ed-e9e306ff4afa tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:37.760904 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9916b088-8ccd-4ea5-a9ed-e9e306ff4afa tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1222 microversion: 2.1 time: 0.254385 Oct 28 12:12:37.764163 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 11/37] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:37 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1222 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:12:38.193320 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3b7c1157-98ae-49a6-9131-f0517dca4f00 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f823eaf0>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:38.258017 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3b7c1157-98ae-49a6-9131-f0517dca4f00 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529" status: 200 len: 286 microversion: 2.1 time: 0.071107 Oct 28 12:12:38.259205 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 27/38] 10.222.0.37 () {58 vars in 1250 bytes} [Thu Oct 28 12:12:38 2021] GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:12:38.681986 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a08bb70f-6177-4049-98d2-d7d10aa856d6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:38.683569 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a08bb70f-6177-4049-98d2-d7d10aa856d6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:38.689687 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a08bb70f-6177-4049-98d2-d7d10aa856d6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:38.690464 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a08bb70f-6177-4049-98d2-d7d10aa856d6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:38.691616 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a08bb70f-6177-4049-98d2-d7d10aa856d6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:38.692464 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a08bb70f-6177-4049-98d2-d7d10aa856d6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:38.823103 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a08bb70f-6177-4049-98d2-d7d10aa856d6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:38.832331 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a08bb70f-6177-4049-98d2-d7d10aa856d6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1267 microversion: 2.1 time: 0.153152 Oct 28 12:12:38.833009 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 28/39] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:38 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:38.923004 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-99b3b00e-0d66-4bcd-a2b8-65da81c44392 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'create', calling method: .version_select at 0x7f11f82fadc0>, body: {"keypair": {"name": "tempest-keypair-618544896"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:12:39.021087 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-99b3b00e-0d66-4bcd-a2b8-65da81c44392 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Getting quotas for project e8919258b85146488d50b07efbad50ca. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:12:39.038167 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-99b3b00e-0d66-4bcd-a2b8-65da81c44392 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Getting quotas for user 8df0567fb17c4b159e7bf0df45012f84 and project e8919258b85146488d50b07efbad50ca. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:12:39.070151 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-86dbbfbd-6249-4a55-b47b-dc559140ecda tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-438095974", "imageRef": "4385a199-a3e9-4c11-b580-60e7a24d0e97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6dd2502a-f306-4bed-bbae-5099ba15a727"}]}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:12:39.171745 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-86dbbfbd-6249-4a55-b47b-dc559140ecda tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] validate_networks() for [('6dd2502a-f306-4bed-bbae-5099ba15a727', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:12:39.694584 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-99b3b00e-0d66-4bcd-a2b8-65da81c44392 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Getting quotas for project e8919258b85146488d50b07efbad50ca. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:12:39.721268 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-99b3b00e-0d66-4bcd-a2b8-65da81c44392 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Getting quotas for user 8df0567fb17c4b159e7bf0df45012f84 and project e8919258b85146488d50b07efbad50ca. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:12:39.767429 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-99b3b00e-0d66-4bcd-a2b8-65da81c44392 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.328093 Oct 28 12:12:39.768776 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 12/40] 10.222.0.37 () {62 vars in 1198 bytes} [Thu Oct 28 12:12:38 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1333 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 28 12:12:39.786100 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-65104765-680f-4923-aaa5-7e1d52982abc tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:39.786901 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-65104765-680f-4923-aaa5-7e1d52982abc tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:39.800896 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-65104765-680f-4923-aaa5-7e1d52982abc tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:39.803082 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-65104765-680f-4923-aaa5-7e1d52982abc tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:39.805119 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-65104765-680f-4923-aaa5-7e1d52982abc tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:39.807339 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-65104765-680f-4923-aaa5-7e1d52982abc tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:39.913014 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-65104765-680f-4923-aaa5-7e1d52982abc tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:39.922412 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-65104765-680f-4923-aaa5-7e1d52982abc tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1270 microversion: 2.1 time: 0.152237 Oct 28 12:12:39.927043 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 13/41] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:39 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:39.934778 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-756d303c-b9c7-4adc-ba97-e7c749389f1d tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f821d790>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:40.001413 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-756d303c-b9c7-4adc-ba97-e7c749389f1d tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529" status: 200 len: 287 microversion: 2.1 time: 0.072434 Oct 28 12:12:40.007715 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 14/42] 10.222.0.37 () {58 vars in 1250 bytes} [Thu Oct 28 12:12:39 2021] GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:12:40.014317 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a367c48d-3100-41b3-96fa-5b8991fd56a8 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:40.015848 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a367c48d-3100-41b3-96fa-5b8991fd56a8 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:40.028488 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a367c48d-3100-41b3-96fa-5b8991fd56a8 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:40.030255 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a367c48d-3100-41b3-96fa-5b8991fd56a8 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:40.031351 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a367c48d-3100-41b3-96fa-5b8991fd56a8 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:40.031972 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a367c48d-3100-41b3-96fa-5b8991fd56a8 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:40.157359 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a367c48d-3100-41b3-96fa-5b8991fd56a8 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:40.173674 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a367c48d-3100-41b3-96fa-5b8991fd56a8 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1273 microversion: 2.1 time: 0.164479 Oct 28 12:12:40.174542 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 15/43] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:40 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:40.187669 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5d15f25b-a5d4-4e1f-ace6-7c4f8087a5e7 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f81ef820>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:40.287242 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-86dbbfbd-6249-4a55-b47b-dc559140ecda tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:12:40.287886 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-86dbbfbd-6249-4a55-b47b-dc559140ecda tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:12:40.288638 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-86dbbfbd-6249-4a55-b47b-dc559140ecda tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:12:40.289233 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-86dbbfbd-6249-4a55-b47b-dc559140ecda tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:12:40.289982 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-86dbbfbd-6249-4a55-b47b-dc559140ecda tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:12:40.310734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-86dbbfbd-6249-4a55-b47b-dc559140ecda tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:40.313051 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-86dbbfbd-6249-4a55-b47b-dc559140ecda tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:40.315439 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-86dbbfbd-6249-4a55-b47b-dc559140ecda tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:40.316529 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-86dbbfbd-6249-4a55-b47b-dc559140ecda tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:40.329331 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5d15f25b-a5d4-4e1f-ace6-7c4f8087a5e7 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "DELETE /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529" status: 202 len: 0 microversion: 2.1 time: 0.152775 Oct 28 12:12:40.330115 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 16/44] 10.222.0.37 () {58 vars in 1253 bytes} [Thu Oct 28 12:12:40 2021] DELETE /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:12:40.339026 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9577e478-f32e-42ad-a52a-3675c9cf56d4 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f81eff70>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:40.385329 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-86dbbfbd-6249-4a55-b47b-dc559140ecda tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Getting quotas for project f7674a1ffc684002a3b3e181e1e3ffd8. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:12:40.396423 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-86dbbfbd-6249-4a55-b47b-dc559140ecda tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Getting quotas for user 9a0d06a4caa747218d2e4c7f96f90095 and project f7674a1ffc684002a3b3e181e1e3ffd8. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:12:40.419942 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9577e478-f32e-42ad-a52a-3675c9cf56d4 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529" status: 200 len: 286 microversion: 2.1 time: 0.084935 Oct 28 12:12:40.420587 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 17/45] 10.222.0.37 () {58 vars in 1250 bytes} [Thu Oct 28 12:12:40 2021] GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529 => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:12:40.435775 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-86dbbfbd-6249-4a55-b47b-dc559140ecda tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:12:40.438183 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-86dbbfbd-6249-4a55-b47b-dc559140ecda tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4385a199-a3e9-4c11-b580-60e7a24d0e97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:12:40.528500 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-86dbbfbd-6249-4a55-b47b-dc559140ecda tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.692605 Oct 28 12:12:40.529218 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 29/46] 10.222.0.37 () {60 vars in 1146 bytes} [Thu Oct 28 12:12:38 2021] POST /compute/v2.1/servers => generated 383 bytes in 1694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:12:40.544411 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0e3ce8f3-dea7-42ab-8a2a-713bd35f5ab0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:40.545293 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0e3ce8f3-dea7-42ab-8a2a-713bd35f5ab0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:40.738408 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0e3ce8f3-dea7-42ab-8a2a-713bd35f5ab0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:40.747062 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0e3ce8f3-dea7-42ab-8a2a-713bd35f5ab0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1221 microversion: 2.1 time: 0.206259 Oct 28 12:12:40.749070 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 18/47] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:40 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1221 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:40.940102 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-55e9e259-0035-43bd-8dc2-62f66e80d961 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:40.941446 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-55e9e259-0035-43bd-8dc2-62f66e80d961 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:40.949653 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-55e9e259-0035-43bd-8dc2-62f66e80d961 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:40.955103 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-55e9e259-0035-43bd-8dc2-62f66e80d961 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:40.958734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-55e9e259-0035-43bd-8dc2-62f66e80d961 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:40.961728 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-55e9e259-0035-43bd-8dc2-62f66e80d961 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:40.977127 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ced0dd26-5ef1-4d8c-ae49-d550fffa54a8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1753203443", "imageRef": "4385a199-a3e9-4c11-b580-60e7a24d0e97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6dd2502a-f306-4bed-bbae-5099ba15a727"}]}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:12:41.201681 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-ced0dd26-5ef1-4d8c-ae49-d550fffa54a8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] validate_networks() for [('6dd2502a-f306-4bed-bbae-5099ba15a727', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:12:41.206405 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-55e9e259-0035-43bd-8dc2-62f66e80d961 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:41.216625 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-55e9e259-0035-43bd-8dc2-62f66e80d961 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1270 microversion: 2.1 time: 0.280120 Oct 28 12:12:41.228496 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 30/48] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:40 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1270 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:41.236333 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e54a1a7d-9793-401e-bc34-d47e656f9ba9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:41.239068 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e54a1a7d-9793-401e-bc34-d47e656f9ba9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:41.254136 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e54a1a7d-9793-401e-bc34-d47e656f9ba9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:41.254698 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e54a1a7d-9793-401e-bc34-d47e656f9ba9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:41.255492 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e54a1a7d-9793-401e-bc34-d47e656f9ba9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:41.255920 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e54a1a7d-9793-401e-bc34-d47e656f9ba9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:41.401473 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e54a1a7d-9793-401e-bc34-d47e656f9ba9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:41.413488 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e54a1a7d-9793-401e-bc34-d47e656f9ba9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1273 microversion: 2.1 time: 0.183406 Oct 28 12:12:41.414387 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 31/49] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:41 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1273 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:41.434604 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0ed200d5-78b0-4cdb-a1f0-1b0fa86e1580 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f81f8e50>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:41.477512 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0ed200d5-78b0-4cdb-a1f0-1b0fa86e1580 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529" status: 200 len: 286 microversion: 2.1 time: 0.048624 Oct 28 12:12:41.481817 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 32/50] 10.222.0.37 () {58 vars in 1250 bytes} [Thu Oct 28 12:12:41 2021] GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:12:42.235667 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ce0fe2a3-0be2-4808-aad1-e99cbb2455a5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:42.237144 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ce0fe2a3-0be2-4808-aad1-e99cbb2455a5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:42.248343 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce0fe2a3-0be2-4808-aad1-e99cbb2455a5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:42.248732 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce0fe2a3-0be2-4808-aad1-e99cbb2455a5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:42.251408 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce0fe2a3-0be2-4808-aad1-e99cbb2455a5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:42.251947 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce0fe2a3-0be2-4808-aad1-e99cbb2455a5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:42.379992 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ce0fe2a3-0be2-4808-aad1-e99cbb2455a5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:42.414403 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ce0fe2a3-0be2-4808-aad1-e99cbb2455a5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1270 microversion: 2.1 time: 0.181216 Oct 28 12:12:42.415139 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 33/51] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:42 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1270 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:42.432594 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1fa1c04c-6ebc-48e0-873c-237f268d5d03 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:42.433471 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1fa1c04c-6ebc-48e0-873c-237f268d5d03 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:42.442837 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1fa1c04c-6ebc-48e0-873c-237f268d5d03 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:42.446899 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1fa1c04c-6ebc-48e0-873c-237f268d5d03 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:42.447986 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1fa1c04c-6ebc-48e0-873c-237f268d5d03 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:42.448604 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1fa1c04c-6ebc-48e0-873c-237f268d5d03 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:42.645935 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-ced0dd26-5ef1-4d8c-ae49-d550fffa54a8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:12:42.646461 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-ced0dd26-5ef1-4d8c-ae49-d550fffa54a8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:12:42.646851 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-ced0dd26-5ef1-4d8c-ae49-d550fffa54a8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:12:42.647265 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-ced0dd26-5ef1-4d8c-ae49-d550fffa54a8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:12:42.647689 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-ced0dd26-5ef1-4d8c-ae49-d550fffa54a8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:12:42.667571 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ced0dd26-5ef1-4d8c-ae49-d550fffa54a8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:42.668012 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ced0dd26-5ef1-4d8c-ae49-d550fffa54a8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:42.668830 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ced0dd26-5ef1-4d8c-ae49-d550fffa54a8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:42.669270 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ced0dd26-5ef1-4d8c-ae49-d550fffa54a8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:42.707253 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-ced0dd26-5ef1-4d8c-ae49-d550fffa54a8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Getting quotas for project f7674a1ffc684002a3b3e181e1e3ffd8. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:12:42.724107 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-ced0dd26-5ef1-4d8c-ae49-d550fffa54a8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Getting quotas for user 9a0d06a4caa747218d2e4c7f96f90095 and project f7674a1ffc684002a3b3e181e1e3ffd8. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:12:42.748983 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ced0dd26-5ef1-4d8c-ae49-d550fffa54a8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:12:42.751633 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ced0dd26-5ef1-4d8c-ae49-d550fffa54a8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4385a199-a3e9-4c11-b580-60e7a24d0e97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:12:42.818436 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ced0dd26-5ef1-4d8c-ae49-d550fffa54a8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.845901 Oct 28 12:12:42.819481 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 19/52] 10.222.0.37 () {60 vars in 1146 bytes} [Thu Oct 28 12:12:40 2021] POST /compute/v2.1/servers => generated 383 bytes in 1848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:12:42.841864 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f593b9fb-ce4a-41ee-b4ec-0abb1eded78d tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f81e9af0>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:42.942757 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f593b9fb-ce4a-41ee-b4ec-0abb1eded78d tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529" status: 200 len: 286 microversion: 2.1 time: 0.121989 Oct 28 12:12:42.943595 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 20/53] 10.222.0.37 () {58 vars in 1250 bytes} [Thu Oct 28 12:12:42 2021] GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529 => generated 286 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:12:42.951859 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5be66868-b65b-4373-9c73-ef00c7cff584 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:42.952786 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5be66868-b65b-4373-9c73-ef00c7cff584 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:43.019644 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1fa1c04c-6ebc-48e0-873c-237f268d5d03 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:43.030703 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1fa1c04c-6ebc-48e0-873c-237f268d5d03 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1273 microversion: 2.1 time: 0.602823 Oct 28 12:12:43.048797 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 34/54] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:42 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1273 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:12:43.179713 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5be66868-b65b-4373-9c73-ef00c7cff584 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:43.198870 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5be66868-b65b-4373-9c73-ef00c7cff584 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1222 microversion: 2.1 time: 0.252861 Oct 28 12:12:43.201407 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 21/55] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:42 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1222 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:43.433188 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8e67c2c5-1d89-412b-81c0-d70786f97bac tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:43.433795 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8e67c2c5-1d89-412b-81c0-d70786f97bac tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:43.447997 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8e67c2c5-1d89-412b-81c0-d70786f97bac tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:43.448779 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8e67c2c5-1d89-412b-81c0-d70786f97bac tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:43.449843 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8e67c2c5-1d89-412b-81c0-d70786f97bac tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:43.450424 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8e67c2c5-1d89-412b-81c0-d70786f97bac tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:43.689127 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8e67c2c5-1d89-412b-81c0-d70786f97bac tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:43.702667 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8e67c2c5-1d89-412b-81c0-d70786f97bac tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1270 microversion: 2.1 time: 0.272127 Oct 28 12:12:43.704732 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 35/56] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:43 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1270 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:43.954228 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-85ac797f-9e46-42c3-9237-4864dcf9b0e3 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f825c8b0>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:44.049168 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7b02c74d-debc-434c-a743-ef54c3534c81 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:44.049778 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7b02c74d-debc-434c-a743-ef54c3534c81 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:44.060410 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7b02c74d-debc-434c-a743-ef54c3534c81 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:44.060870 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7b02c74d-debc-434c-a743-ef54c3534c81 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:44.061660 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7b02c74d-debc-434c-a743-ef54c3534c81 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:44.062091 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7b02c74d-debc-434c-a743-ef54c3534c81 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:44.088379 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-85ac797f-9e46-42c3-9237-4864dcf9b0e3 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529" status: 200 len: 286 microversion: 2.1 time: 0.137640 Oct 28 12:12:44.089220 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 22/57] 10.222.0.37 () {58 vars in 1250 bytes} [Thu Oct 28 12:12:43 2021] GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:12:44.217316 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-05dc90d7-b1d8-4258-b4e8-f9790b1309df tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:44.218063 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-05dc90d7-b1d8-4258-b4e8-f9790b1309df tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:44.227578 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05dc90d7-b1d8-4258-b4e8-f9790b1309df tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:44.228029 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05dc90d7-b1d8-4258-b4e8-f9790b1309df tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:44.228817 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05dc90d7-b1d8-4258-b4e8-f9790b1309df tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:44.229252 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05dc90d7-b1d8-4258-b4e8-f9790b1309df tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:44.906574 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-05dc90d7-b1d8-4258-b4e8-f9790b1309df tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:44.919350 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-05dc90d7-b1d8-4258-b4e8-f9790b1309df tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1218 microversion: 2.1 time: 0.705785 Oct 28 12:12:44.920497 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 23/58] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:44 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1218 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:12:44.932946 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-54d973ab-b475-4262-a280-acc6f5f8f188 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:44.939694 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-54d973ab-b475-4262-a280-acc6f5f8f188 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:44.976539 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54d973ab-b475-4262-a280-acc6f5f8f188 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:44.978001 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54d973ab-b475-4262-a280-acc6f5f8f188 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:44.984087 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54d973ab-b475-4262-a280-acc6f5f8f188 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:44.986304 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54d973ab-b475-4262-a280-acc6f5f8f188 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:45.114052 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-54d973ab-b475-4262-a280-acc6f5f8f188 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:45.135125 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-54d973ab-b475-4262-a280-acc6f5f8f188 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1276 microversion: 2.1 time: 0.211826 Oct 28 12:12:45.146439 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 24/59] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:44 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1276 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:45.154192 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5503bee8-b6e0-4b34-9913-24d6e5c4dc6d tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f821d3a0>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:45.200723 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-5503bee8-b6e0-4b34-9913-24d6e5c4dc6d tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] HTTP exception thrown: Snapshot cd58baca-8e20-44d7-a63e-197667e20529 could not be found. Oct 28 12:12:45.201534 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5503bee8-b6e0-4b34-9913-24d6e5c4dc6d tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Returning 404 to user: Snapshot cd58baca-8e20-44d7-a63e-197667e20529 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:12:45.202540 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5503bee8-b6e0-4b34-9913-24d6e5c4dc6d tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529" status: 404 len: 111 microversion: 2.1 time: 0.053439 Oct 28 12:12:45.203262 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 25/60] 10.222.0.37 () {58 vars in 1250 bytes} [Thu Oct 28 12:12:45 2021] GET /compute/v2.1/os-snapshots/cd58baca-8e20-44d7-a63e-197667e20529 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:12:45.214101 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-30461aa2-d0b5-464a-9060-c61d18602aeb tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f81ef5e0>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:45.342203 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-30461aa2-d0b5-464a-9060-c61d18602aeb tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/700a7917-e7e9-482d-b6d3-feb3e436f3f3" status: 202 len: 0 microversion: 2.1 time: 0.130132 Oct 28 12:12:45.342825 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 26/61] 10.222.0.37 () {58 vars in 1247 bytes} [Thu Oct 28 12:12:45 2021] DELETE /compute/v2.1/os-volumes/700a7917-e7e9-482d-b6d3-feb3e436f3f3 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:12:45.363269 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e9fc72db-ab0c-4b1b-b423-5204cacf62d2 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f8282f70>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:45.488826 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e9fc72db-ab0c-4b1b-b423-5204cacf62d2 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/700a7917-e7e9-482d-b6d3-feb3e436f3f3" status: 200 len: 342 microversion: 2.1 time: 0.135008 Oct 28 12:12:45.489816 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 27/62] 10.222.0.37 () {58 vars in 1244 bytes} [Thu Oct 28 12:12:45 2021] GET /compute/v2.1/os-volumes/700a7917-e7e9-482d-b6d3-feb3e436f3f3 => generated 342 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:12:45.616102 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7b02c74d-debc-434c-a743-ef54c3534c81 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:45.629679 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7b02c74d-debc-434c-a743-ef54c3534c81 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 1.584213 Oct 28 12:12:45.632019 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 36/63] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:44 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:12:45.939251 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fe51b323-bdaa-4e07-aa8c-c1663aed6d96 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:45.939853 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fe51b323-bdaa-4e07-aa8c-c1663aed6d96 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:45.956010 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe51b323-bdaa-4e07-aa8c-c1663aed6d96 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:45.956835 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe51b323-bdaa-4e07-aa8c-c1663aed6d96 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:45.958063 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe51b323-bdaa-4e07-aa8c-c1663aed6d96 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:45.958873 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe51b323-bdaa-4e07-aa8c-c1663aed6d96 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:46.065266 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fe51b323-bdaa-4e07-aa8c-c1663aed6d96 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:46.078648 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fe51b323-bdaa-4e07-aa8c-c1663aed6d96 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1218 microversion: 2.1 time: 0.144468 Oct 28 12:12:46.090517 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 28/64] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:45 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1218 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:46.154234 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-53d5d884-b4b0-4523-9399-115a576a9000 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:46.155125 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-53d5d884-b4b0-4523-9399-115a576a9000 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:46.173581 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-53d5d884-b4b0-4523-9399-115a576a9000 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:46.177844 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-53d5d884-b4b0-4523-9399-115a576a9000 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:46.179175 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-53d5d884-b4b0-4523-9399-115a576a9000 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:46.179792 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-53d5d884-b4b0-4523-9399-115a576a9000 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:46.512250 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-897ebd47-e13e-449e-aa01-00e22ab8c026 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f821df70>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:46.522591 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-53d5d884-b4b0-4523-9399-115a576a9000 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:46.561994 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-53d5d884-b4b0-4523-9399-115a576a9000 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1276 microversion: 2.1 time: 0.410313 Oct 28 12:12:46.563417 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 37/65] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:46 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1276 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:12:46.647938 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-897ebd47-e13e-449e-aa01-00e22ab8c026 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] HTTP exception thrown: Volume 700a7917-e7e9-482d-b6d3-feb3e436f3f3 could not be found. Oct 28 12:12:46.649184 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-897ebd47-e13e-449e-aa01-00e22ab8c026 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Returning 404 to user: Volume 700a7917-e7e9-482d-b6d3-feb3e436f3f3 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:12:46.650508 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6c52e2f2-1462-4106-bf5e-735e6b8c42bf tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:46.651026 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-897ebd47-e13e-449e-aa01-00e22ab8c026 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/700a7917-e7e9-482d-b6d3-feb3e436f3f3" status: 404 len: 109 microversion: 2.1 time: 0.151887 Oct 28 12:12:46.651605 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 29/66] 10.222.0.37 () {58 vars in 1244 bytes} [Thu Oct 28 12:12:46 2021] GET /compute/v2.1/os-volumes/700a7917-e7e9-482d-b6d3-feb3e436f3f3 => generated 109 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 12:12:46.652095 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6c52e2f2-1462-4106-bf5e-735e6b8c42bf tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:46.660278 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6c52e2f2-1462-4106-bf5e-735e6b8c42bf tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:46.661180 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6c52e2f2-1462-4106-bf5e-735e6b8c42bf tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:46.662461 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6c52e2f2-1462-4106-bf5e-735e6b8c42bf tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:46.663056 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6c52e2f2-1462-4106-bf5e-735e6b8c42bf tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:46.678441 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cc7ba7c1-b97e-468d-bc44-fb30ba5d12b3 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f81a91f0>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:46.755977 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-cc7ba7c1-b97e-468d-bc44-fb30ba5d12b3 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] HTTP exception thrown: Volume 700a7917-e7e9-482d-b6d3-feb3e436f3f3 could not be found. Oct 28 12:12:46.756565 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cc7ba7c1-b97e-468d-bc44-fb30ba5d12b3 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Returning 404 to user: Volume 700a7917-e7e9-482d-b6d3-feb3e436f3f3 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:12:46.757390 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cc7ba7c1-b97e-468d-bc44-fb30ba5d12b3 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/700a7917-e7e9-482d-b6d3-feb3e436f3f3" status: 404 len: 109 microversion: 2.1 time: 0.085361 Oct 28 12:12:46.757935 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 30/67] 10.222.0.37 () {58 vars in 1247 bytes} [Thu Oct 28 12:12:46 2021] DELETE /compute/v2.1/os-volumes/700a7917-e7e9-482d-b6d3-feb3e436f3f3 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:12:46.766200 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9f9034ec-d66a-4dbe-ba7f-9273b42a73a4 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Calling method '.version_select at 0x7f11f8b5f310>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:46.820739 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-9f9034ec-d66a-4dbe-ba7f-9273b42a73a4 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] HTTP exception thrown: Volume 700a7917-e7e9-482d-b6d3-feb3e436f3f3 could not be found. Oct 28 12:12:46.821343 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9f9034ec-d66a-4dbe-ba7f-9273b42a73a4 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] Returning 404 to user: Volume 700a7917-e7e9-482d-b6d3-feb3e436f3f3 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:12:46.822167 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9f9034ec-d66a-4dbe-ba7f-9273b42a73a4 tempest-VolumesSnapshotsTestJSON-1499070896 tempest-VolumesSnapshotsTestJSON-1499070896-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/700a7917-e7e9-482d-b6d3-feb3e436f3f3" status: 404 len: 109 microversion: 2.1 time: 0.059732 Oct 28 12:12:46.823005 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 31/68] 10.222.0.37 () {58 vars in 1244 bytes} [Thu Oct 28 12:12:46 2021] GET /compute/v2.1/os-volumes/700a7917-e7e9-482d-b6d3-feb3e436f3f3 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 12:12:47.096923 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-735f28ae-d6dd-415d-8a46-79ada2d9de9d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:47.098036 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-735f28ae-d6dd-415d-8a46-79ada2d9de9d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:47.106733 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-735f28ae-d6dd-415d-8a46-79ada2d9de9d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:47.114646 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-735f28ae-d6dd-415d-8a46-79ada2d9de9d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:47.120010 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6c52e2f2-1462-4106-bf5e-735e6b8c42bf tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:47.122128 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-735f28ae-d6dd-415d-8a46-79ada2d9de9d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:47.122822 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-735f28ae-d6dd-415d-8a46-79ada2d9de9d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:47.138725 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6c52e2f2-1462-4106-bf5e-735e6b8c42bf tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.489996 Oct 28 12:12:47.140964 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 38/69] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:46 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:47.299448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-735f28ae-d6dd-415d-8a46-79ada2d9de9d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:47.313081 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-735f28ae-d6dd-415d-8a46-79ada2d9de9d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1218 microversion: 2.1 time: 0.220335 Oct 28 12:12:47.317750 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 32/70] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:47 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1218 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:47.561504 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-de584122-7b57-4225-a11e-cdf4e431f804 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1428112186", "imageRef": "4385a199-a3e9-4c11-b580-60e7a24d0e97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5853af4e-080d-4f95-bfd5-3fa948549140"}], "security_groups": [{"name": "tempest-securitygroup--1747476213"}], "key_name": "tempest-keypair-618544896", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:12:47.596057 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-77dc082d-eca5-4438-8c85-6168d50c5997 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:47.601472 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-77dc082d-eca5-4438-8c85-6168d50c5997 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:47.628782 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-77dc082d-eca5-4438-8c85-6168d50c5997 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:47.629494 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-77dc082d-eca5-4438-8c85-6168d50c5997 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:47.630317 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-77dc082d-eca5-4438-8c85-6168d50c5997 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:47.630769 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-77dc082d-eca5-4438-8c85-6168d50c5997 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:47.905220 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-de584122-7b57-4225-a11e-cdf4e431f804 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] validate_networks() for [('5853af4e-080d-4f95-bfd5-3fa948549140', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:12:48.185140 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-77dc082d-eca5-4438-8c85-6168d50c5997 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:48.206464 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-77dc082d-eca5-4438-8c85-6168d50c5997 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.617549 Oct 28 12:12:48.207783 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 33/71] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:47 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:48.216589 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-899d42f6-7ad7-4ba3-b8d8-e12eaca4eb84 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:48.225431 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-899d42f6-7ad7-4ba3-b8d8-e12eaca4eb84 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:48.241160 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-899d42f6-7ad7-4ba3-b8d8-e12eaca4eb84 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:48.241865 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-899d42f6-7ad7-4ba3-b8d8-e12eaca4eb84 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:48.242851 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-899d42f6-7ad7-4ba3-b8d8-e12eaca4eb84 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:48.243323 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-899d42f6-7ad7-4ba3-b8d8-e12eaca4eb84 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:48.473759 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-899d42f6-7ad7-4ba3-b8d8-e12eaca4eb84 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:48.483108 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-899d42f6-7ad7-4ba3-b8d8-e12eaca4eb84 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.270367 Oct 28 12:12:48.484054 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 34/72] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:48 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:48.491542 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a41e25be-972e-4098-8308-f0952f6b8bbb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:48.492696 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a41e25be-972e-4098-8308-f0952f6b8bbb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:48.501054 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a41e25be-972e-4098-8308-f0952f6b8bbb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:48.501616 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a41e25be-972e-4098-8308-f0952f6b8bbb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:48.502697 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a41e25be-972e-4098-8308-f0952f6b8bbb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:48.503349 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a41e25be-972e-4098-8308-f0952f6b8bbb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:48.597673 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a41e25be-972e-4098-8308-f0952f6b8bbb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:48.608437 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a41e25be-972e-4098-8308-f0952f6b8bbb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1218 microversion: 2.1 time: 0.122737 Oct 28 12:12:48.620572 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 35/73] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:48 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:48.848172 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-de584122-7b57-4225-a11e-cdf4e431f804 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:12:48.848652 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-de584122-7b57-4225-a11e-cdf4e431f804 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:12:48.849206 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-de584122-7b57-4225-a11e-cdf4e431f804 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:12:48.849994 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-de584122-7b57-4225-a11e-cdf4e431f804 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:12:48.850420 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-de584122-7b57-4225-a11e-cdf4e431f804 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:12:48.861739 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-de584122-7b57-4225-a11e-cdf4e431f804 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:48.862997 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-de584122-7b57-4225-a11e-cdf4e431f804 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:48.864372 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-de584122-7b57-4225-a11e-cdf4e431f804 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:48.864979 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-de584122-7b57-4225-a11e-cdf4e431f804 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:48.905102 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-de584122-7b57-4225-a11e-cdf4e431f804 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Getting quotas for project e8919258b85146488d50b07efbad50ca. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:12:48.909610 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-de584122-7b57-4225-a11e-cdf4e431f804 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Getting quotas for user 8df0567fb17c4b159e7bf0df45012f84 and project e8919258b85146488d50b07efbad50ca. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:12:48.930643 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-de584122-7b57-4225-a11e-cdf4e431f804 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:12:48.933157 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-de584122-7b57-4225-a11e-cdf4e431f804 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4385a199-a3e9-4c11-b580-60e7a24d0e97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:12:49.005916 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-de584122-7b57-4225-a11e-cdf4e431f804 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.450861 Oct 28 12:12:49.018742 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 39/74] 10.222.0.37 () {62 vars in 1187 bytes} [Thu Oct 28 12:12:47 2021] POST /compute/v2.1/servers => generated 402 bytes in 1461 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 12:12:49.025732 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d500a4af-f132-422b-9e6e-821f6f81480e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:49.026611 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d500a4af-f132-422b-9e6e-821f6f81480e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:49.153267 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d500a4af-f132-422b-9e6e-821f6f81480e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:49.164369 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d500a4af-f132-422b-9e6e-821f6f81480e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:49.169822 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d500a4af-f132-422b-9e6e-821f6f81480e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:49.178178 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d500a4af-f132-422b-9e6e-821f6f81480e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1281 microversion: 2.20 time: 0.149667 Oct 28 12:12:49.187399 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 36/75] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:12:49 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1281 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:12:49.224479 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-50b9931f-32a2-44ba-b548-d763e3d5cf07 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:49.225093 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-50b9931f-32a2-44ba-b548-d763e3d5cf07 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:49.242716 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-50b9931f-32a2-44ba-b548-d763e3d5cf07 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:49.243169 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-50b9931f-32a2-44ba-b548-d763e3d5cf07 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:49.243958 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-50b9931f-32a2-44ba-b548-d763e3d5cf07 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:49.244388 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-50b9931f-32a2-44ba-b548-d763e3d5cf07 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:49.452367 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-50b9931f-32a2-44ba-b548-d763e3d5cf07 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:49.469778 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-50b9931f-32a2-44ba-b548-d763e3d5cf07 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.242486 Oct 28 12:12:49.470663 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 40/76] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:49 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:49.511130 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-add8caf2-99d5-4301-aada-ad4e61bad193 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:49.513657 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-add8caf2-99d5-4301-aada-ad4e61bad193 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:49.532143 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-add8caf2-99d5-4301-aada-ad4e61bad193 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:49.533098 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-add8caf2-99d5-4301-aada-ad4e61bad193 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:49.538631 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-add8caf2-99d5-4301-aada-ad4e61bad193 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:49.539657 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-add8caf2-99d5-4301-aada-ad4e61bad193 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:49.629135 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-adf2667f-884a-4b10-971e-2aae6bb2cd7d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:49.629838 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-adf2667f-884a-4b10-971e-2aae6bb2cd7d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:49.640508 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-adf2667f-884a-4b10-971e-2aae6bb2cd7d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:49.648198 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-adf2667f-884a-4b10-971e-2aae6bb2cd7d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:49.650576 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-adf2667f-884a-4b10-971e-2aae6bb2cd7d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:49.652656 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-adf2667f-884a-4b10-971e-2aae6bb2cd7d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:49.861937 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-adf2667f-884a-4b10-971e-2aae6bb2cd7d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:49.877989 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-adf2667f-884a-4b10-971e-2aae6bb2cd7d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1218 microversion: 2.1 time: 0.246377 Oct 28 12:12:49.877989 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 41/77] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:49 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1218 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:12:49.879918 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-add8caf2-99d5-4301-aada-ad4e61bad193 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:49.931221 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-add8caf2-99d5-4301-aada-ad4e61bad193 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.429025 Oct 28 12:12:49.942597 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 37/78] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:49 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:50.194347 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-58cdf918-0130-4bb5-8cc6-58a2a27dc34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:50.198866 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-58cdf918-0130-4bb5-8cc6-58a2a27dc34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:50.202230 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58cdf918-0130-4bb5-8cc6-58a2a27dc34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:50.203064 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58cdf918-0130-4bb5-8cc6-58a2a27dc34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:50.205470 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58cdf918-0130-4bb5-8cc6-58a2a27dc34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:50.207404 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58cdf918-0130-4bb5-8cc6-58a2a27dc34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:50.295387 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-58cdf918-0130-4bb5-8cc6-58a2a27dc34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:50.307072 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-58cdf918-0130-4bb5-8cc6-58a2a27dc34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:50.311445 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-58cdf918-0130-4bb5-8cc6-58a2a27dc34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:50.316890 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-58cdf918-0130-4bb5-8cc6-58a2a27dc34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1285 microversion: 2.20 time: 0.126546 Oct 28 12:12:50.322265 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 42/79] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:12:50 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:12:50.493603 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-01b14c2b-f86f-4e2b-a2b4-f21ea6bd8779 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:50.494999 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-01b14c2b-f86f-4e2b-a2b4-f21ea6bd8779 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:50.502196 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01b14c2b-f86f-4e2b-a2b4-f21ea6bd8779 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:50.503895 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01b14c2b-f86f-4e2b-a2b4-f21ea6bd8779 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:50.505281 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01b14c2b-f86f-4e2b-a2b4-f21ea6bd8779 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:50.513515 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01b14c2b-f86f-4e2b-a2b4-f21ea6bd8779 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:50.908416 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-799f9f41-a424-44ae-950b-522de7a0c037 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:50.910902 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-799f9f41-a424-44ae-950b-522de7a0c037 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:50.920128 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-01b14c2b-f86f-4e2b-a2b4-f21ea6bd8779 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:50.921048 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-799f9f41-a424-44ae-950b-522de7a0c037 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:50.922319 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-799f9f41-a424-44ae-950b-522de7a0c037 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:50.923940 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-799f9f41-a424-44ae-950b-522de7a0c037 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:50.924546 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-799f9f41-a424-44ae-950b-522de7a0c037 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:50.929785 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-01b14c2b-f86f-4e2b-a2b4-f21ea6bd8779 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.440353 Oct 28 12:12:50.941201 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 38/80] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:50 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:50.953351 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-694d2fa6-fbe2-4c05-ac07-2c4e2c4dbb03 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:50.954331 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-694d2fa6-fbe2-4c05-ac07-2c4e2c4dbb03 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:50.973347 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-694d2fa6-fbe2-4c05-ac07-2c4e2c4dbb03 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:50.974179 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-694d2fa6-fbe2-4c05-ac07-2c4e2c4dbb03 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:50.975906 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-694d2fa6-fbe2-4c05-ac07-2c4e2c4dbb03 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:50.976974 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-694d2fa6-fbe2-4c05-ac07-2c4e2c4dbb03 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:51.017649 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-799f9f41-a424-44ae-950b-522de7a0c037 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:51.028527 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-799f9f41-a424-44ae-950b-522de7a0c037 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1218 microversion: 2.1 time: 0.133339 Oct 28 12:12:51.033447 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 43/81] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:50 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:51.181714 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-694d2fa6-fbe2-4c05-ac07-2c4e2c4dbb03 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:51.191891 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-694d2fa6-fbe2-4c05-ac07-2c4e2c4dbb03 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.246237 Oct 28 12:12:51.199084 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 39/82] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:50 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:51.347288 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4c2f15c6-c952-4516-84c3-a0e71c92903f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:51.348745 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4c2f15c6-c952-4516-84c3-a0e71c92903f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:51.355879 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4c2f15c6-c952-4516-84c3-a0e71c92903f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:51.356654 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4c2f15c6-c952-4516-84c3-a0e71c92903f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:51.357521 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4c2f15c6-c952-4516-84c3-a0e71c92903f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:51.358099 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4c2f15c6-c952-4516-84c3-a0e71c92903f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:51.429432 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4c2f15c6-c952-4516-84c3-a0e71c92903f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:51.443446 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4c2f15c6-c952-4516-84c3-a0e71c92903f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:51.446523 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4c2f15c6-c952-4516-84c3-a0e71c92903f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:51.447712 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4c2f15c6-c952-4516-84c3-a0e71c92903f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1285 microversion: 2.20 time: 0.109845 Oct 28 12:12:51.448268 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 44/83] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:12:51 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:12:51.949400 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f47614a8-04ca-4ef7-9026-1e97c12b156a tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:51.950234 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f47614a8-04ca-4ef7-9026-1e97c12b156a tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:51.959700 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f47614a8-04ca-4ef7-9026-1e97c12b156a tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:51.961545 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f47614a8-04ca-4ef7-9026-1e97c12b156a tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:51.968392 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f47614a8-04ca-4ef7-9026-1e97c12b156a tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:51.969701 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f47614a8-04ca-4ef7-9026-1e97c12b156a tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:52.054451 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-96bc8168-7bd7-4b5f-861b-50e75f9ba107 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:52.055224 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-96bc8168-7bd7-4b5f-861b-50e75f9ba107 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:52.087782 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-96bc8168-7bd7-4b5f-861b-50e75f9ba107 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:52.088522 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-96bc8168-7bd7-4b5f-861b-50e75f9ba107 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:52.090750 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-96bc8168-7bd7-4b5f-861b-50e75f9ba107 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:52.091627 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-96bc8168-7bd7-4b5f-861b-50e75f9ba107 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:52.188464 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-96bc8168-7bd7-4b5f-861b-50e75f9ba107 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:52.200488 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-96bc8168-7bd7-4b5f-861b-50e75f9ba107 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1218 microversion: 2.1 time: 0.151922 Oct 28 12:12:52.201334 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 45/84] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:52 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:52.217272 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-95b651bd-4b69-43c3-b41c-b76453ede7c1 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:52.218966 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-95b651bd-4b69-43c3-b41c-b76453ede7c1 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:52.232794 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-95b651bd-4b69-43c3-b41c-b76453ede7c1 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:52.233389 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-95b651bd-4b69-43c3-b41c-b76453ede7c1 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:52.234319 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-95b651bd-4b69-43c3-b41c-b76453ede7c1 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:52.245397 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-95b651bd-4b69-43c3-b41c-b76453ede7c1 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:52.274418 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f47614a8-04ca-4ef7-9026-1e97c12b156a tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:52.282583 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f47614a8-04ca-4ef7-9026-1e97c12b156a tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.337158 Oct 28 12:12:52.298672 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 40/85] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:51 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:52.465715 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-67422ffb-17e3-43cb-8cb8-9e6ac794d82a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:52.466444 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-67422ffb-17e3-43cb-8cb8-9e6ac794d82a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:52.482586 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-67422ffb-17e3-43cb-8cb8-9e6ac794d82a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:52.483239 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-67422ffb-17e3-43cb-8cb8-9e6ac794d82a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:52.484204 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-67422ffb-17e3-43cb-8cb8-9e6ac794d82a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:52.484914 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-67422ffb-17e3-43cb-8cb8-9e6ac794d82a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:52.506179 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-95b651bd-4b69-43c3-b41c-b76453ede7c1 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:52.515832 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-95b651bd-4b69-43c3-b41c-b76453ede7c1 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.306139 Oct 28 12:12:52.516666 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 46/86] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:52 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:52.604035 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-67422ffb-17e3-43cb-8cb8-9e6ac794d82a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:52.619613 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-67422ffb-17e3-43cb-8cb8-9e6ac794d82a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:52.628316 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-67422ffb-17e3-43cb-8cb8-9e6ac794d82a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:52.630455 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-67422ffb-17e3-43cb-8cb8-9e6ac794d82a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1285 microversion: 2.20 time: 0.168473 Oct 28 12:12:52.631884 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 41/87] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:12:52 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:12:53.220544 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f7c5268f-1802-4ed4-b7be-d765d18557e6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:53.221359 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f7c5268f-1802-4ed4-b7be-d765d18557e6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:53.230704 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f7c5268f-1802-4ed4-b7be-d765d18557e6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:53.231407 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f7c5268f-1802-4ed4-b7be-d765d18557e6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:53.232537 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f7c5268f-1802-4ed4-b7be-d765d18557e6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:53.233754 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f7c5268f-1802-4ed4-b7be-d765d18557e6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:53.306127 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c320480c-4cb4-4680-9130-f646c53745b1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:53.307371 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c320480c-4cb4-4680-9130-f646c53745b1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:53.313507 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c320480c-4cb4-4680-9130-f646c53745b1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:53.314310 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c320480c-4cb4-4680-9130-f646c53745b1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:53.315188 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c320480c-4cb4-4680-9130-f646c53745b1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:53.315867 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c320480c-4cb4-4680-9130-f646c53745b1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:53.348421 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f7c5268f-1802-4ed4-b7be-d765d18557e6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:53.367281 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f7c5268f-1802-4ed4-b7be-d765d18557e6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1218 microversion: 2.1 time: 0.151362 Oct 28 12:12:53.369137 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 47/88] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:53 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:53.534142 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-08392522-e96d-4cee-bd43-d9f20e5041d0 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:53.534847 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-08392522-e96d-4cee-bd43-d9f20e5041d0 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:53.545867 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08392522-e96d-4cee-bd43-d9f20e5041d0 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:53.547047 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08392522-e96d-4cee-bd43-d9f20e5041d0 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:53.553372 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c320480c-4cb4-4680-9130-f646c53745b1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:53.568878 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08392522-e96d-4cee-bd43-d9f20e5041d0 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:53.571730 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08392522-e96d-4cee-bd43-d9f20e5041d0 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:53.574613 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c320480c-4cb4-4680-9130-f646c53745b1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.272619 Oct 28 12:12:53.578406 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 42/89] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:53 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:53.648413 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-67eb3991-9aab-409b-a9c0-509e8423f751 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:53.649452 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-67eb3991-9aab-409b-a9c0-509e8423f751 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:53.659643 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-67eb3991-9aab-409b-a9c0-509e8423f751 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:53.660441 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-67eb3991-9aab-409b-a9c0-509e8423f751 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:53.661701 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-67eb3991-9aab-409b-a9c0-509e8423f751 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:53.664952 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-67eb3991-9aab-409b-a9c0-509e8423f751 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:53.851023 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-67eb3991-9aab-409b-a9c0-509e8423f751 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:53.864478 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-67eb3991-9aab-409b-a9c0-509e8423f751 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:53.880493 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-67eb3991-9aab-409b-a9c0-509e8423f751 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:53.891074 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-67eb3991-9aab-409b-a9c0-509e8423f751 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1285 microversion: 2.20 time: 0.246679 Oct 28 12:12:53.892400 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 43/90] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:12:53 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1285 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:12:53.928672 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-08392522-e96d-4cee-bd43-d9f20e5041d0 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:53.938727 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-08392522-e96d-4cee-bd43-d9f20e5041d0 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.408736 Oct 28 12:12:53.939316 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 48/91] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:53 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:54.385948 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5f59f743-f8c2-4804-91b0-ee16c35013f2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:54.399011 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5f59f743-f8c2-4804-91b0-ee16c35013f2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:54.422693 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5f59f743-f8c2-4804-91b0-ee16c35013f2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:54.423543 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5f59f743-f8c2-4804-91b0-ee16c35013f2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:54.427217 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5f59f743-f8c2-4804-91b0-ee16c35013f2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:54.427737 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5f59f743-f8c2-4804-91b0-ee16c35013f2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:54.570789 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5f59f743-f8c2-4804-91b0-ee16c35013f2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:54.585629 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5f59f743-f8c2-4804-91b0-ee16c35013f2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1218 microversion: 2.1 time: 0.203362 Oct 28 12:12:54.586533 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 44/92] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:54 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1218 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:54.599489 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-491607fe-8edd-4380-9421-10cf09d2b53e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:54.600543 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-491607fe-8edd-4380-9421-10cf09d2b53e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:54.612013 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-491607fe-8edd-4380-9421-10cf09d2b53e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:54.612679 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-491607fe-8edd-4380-9421-10cf09d2b53e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:54.613678 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-491607fe-8edd-4380-9421-10cf09d2b53e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:54.614213 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-491607fe-8edd-4380-9421-10cf09d2b53e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:54.799476 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-491607fe-8edd-4380-9421-10cf09d2b53e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:54.818641 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-491607fe-8edd-4380-9421-10cf09d2b53e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.224928 Oct 28 12:12:54.819659 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 49/93] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:54 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:54.911004 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a98418a5-313e-4112-a85a-4dcfd605a045 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:54.911855 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a98418a5-313e-4112-a85a-4dcfd605a045 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:54.918473 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a98418a5-313e-4112-a85a-4dcfd605a045 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:54.919223 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a98418a5-313e-4112-a85a-4dcfd605a045 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:54.920014 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a98418a5-313e-4112-a85a-4dcfd605a045 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:54.921543 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a98418a5-313e-4112-a85a-4dcfd605a045 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:54.957462 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ae943309-f1e0-4907-97c3-a61a45d07c5c tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:54.958721 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ae943309-f1e0-4907-97c3-a61a45d07c5c tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:54.983062 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ae943309-f1e0-4907-97c3-a61a45d07c5c tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:54.985253 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ae943309-f1e0-4907-97c3-a61a45d07c5c tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:54.986312 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ae943309-f1e0-4907-97c3-a61a45d07c5c tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:54.991451 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ae943309-f1e0-4907-97c3-a61a45d07c5c tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:55.013037 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a98418a5-313e-4112-a85a-4dcfd605a045 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:55.031405 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a98418a5-313e-4112-a85a-4dcfd605a045 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:55.031405 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a98418a5-313e-4112-a85a-4dcfd605a045 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:55.031405 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a98418a5-313e-4112-a85a-4dcfd605a045 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1285 microversion: 2.20 time: 0.120166 Oct 28 12:12:55.034671 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 45/94] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:12:54 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:12:55.155314 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ae943309-f1e0-4907-97c3-a61a45d07c5c tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:55.165485 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ae943309-f1e0-4907-97c3-a61a45d07c5c tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.212667 Oct 28 12:12:55.175710 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 50/95] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:54 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:12:55.603760 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-31e74d8b-fd2d-4fef-9848-1a5d6d69c73c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:55.605084 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-31e74d8b-fd2d-4fef-9848-1a5d6d69c73c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:55.613004 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-31e74d8b-fd2d-4fef-9848-1a5d6d69c73c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:55.613997 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-31e74d8b-fd2d-4fef-9848-1a5d6d69c73c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:55.615134 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-31e74d8b-fd2d-4fef-9848-1a5d6d69c73c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:55.615860 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-31e74d8b-fd2d-4fef-9848-1a5d6d69c73c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:55.702265 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-31e74d8b-fd2d-4fef-9848-1a5d6d69c73c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:55.715435 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-31e74d8b-fd2d-4fef-9848-1a5d6d69c73c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1218 microversion: 2.1 time: 0.116122 Oct 28 12:12:55.716959 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 46/96] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:55 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:12:55.836658 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4163895f-14bc-4575-ba7f-3558616f57f6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:55.837880 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4163895f-14bc-4575-ba7f-3558616f57f6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:55.845890 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4163895f-14bc-4575-ba7f-3558616f57f6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:55.847506 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4163895f-14bc-4575-ba7f-3558616f57f6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:55.848511 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4163895f-14bc-4575-ba7f-3558616f57f6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:55.849082 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4163895f-14bc-4575-ba7f-3558616f57f6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:55.991218 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4163895f-14bc-4575-ba7f-3558616f57f6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:55.999457 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4163895f-14bc-4575-ba7f-3558616f57f6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.166642 Oct 28 12:12:56.000380 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 51/97] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:55 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:56.050655 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a28fa7f9-6a60-456c-ae95-d9e6919c907c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:56.051528 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a28fa7f9-6a60-456c-ae95-d9e6919c907c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:56.057494 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a28fa7f9-6a60-456c-ae95-d9e6919c907c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:56.057932 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a28fa7f9-6a60-456c-ae95-d9e6919c907c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:56.058779 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a28fa7f9-6a60-456c-ae95-d9e6919c907c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:56.059136 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a28fa7f9-6a60-456c-ae95-d9e6919c907c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:56.129943 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a28fa7f9-6a60-456c-ae95-d9e6919c907c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:56.138359 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a28fa7f9-6a60-456c-ae95-d9e6919c907c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:56.140576 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a28fa7f9-6a60-456c-ae95-d9e6919c907c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:56.142507 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a28fa7f9-6a60-456c-ae95-d9e6919c907c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1285 microversion: 2.20 time: 0.096619 Oct 28 12:12:56.143674 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 47/98] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:12:56 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:12:56.184220 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e51237b6-4d72-4344-ba99-7d7162a05f47 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:56.184897 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e51237b6-4d72-4344-ba99-7d7162a05f47 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:56.191082 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e51237b6-4d72-4344-ba99-7d7162a05f47 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:56.191604 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e51237b6-4d72-4344-ba99-7d7162a05f47 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:56.192833 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e51237b6-4d72-4344-ba99-7d7162a05f47 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:56.193265 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e51237b6-4d72-4344-ba99-7d7162a05f47 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:56.333026 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e51237b6-4d72-4344-ba99-7d7162a05f47 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:56.341892 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e51237b6-4d72-4344-ba99-7d7162a05f47 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.161733 Oct 28 12:12:56.342726 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 52/99] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:56 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:12:56.733496 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3c214202-212b-43bb-bd8e-ad299ddb160d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:56.734262 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3c214202-212b-43bb-bd8e-ad299ddb160d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:56.741179 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3c214202-212b-43bb-bd8e-ad299ddb160d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:56.741623 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3c214202-212b-43bb-bd8e-ad299ddb160d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:56.742593 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3c214202-212b-43bb-bd8e-ad299ddb160d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:56.743045 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3c214202-212b-43bb-bd8e-ad299ddb160d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:56.820235 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3c214202-212b-43bb-bd8e-ad299ddb160d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:56.827821 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3c214202-212b-43bb-bd8e-ad299ddb160d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1218 microversion: 2.1 time: 0.097873 Oct 28 12:12:56.828402 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 48/100] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:56 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:57.025076 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-62e7cfa2-0dd1-4c0a-9326-561730574f57 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:57.025794 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-62e7cfa2-0dd1-4c0a-9326-561730574f57 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:57.032963 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-62e7cfa2-0dd1-4c0a-9326-561730574f57 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:57.033718 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-62e7cfa2-0dd1-4c0a-9326-561730574f57 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:57.034592 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-62e7cfa2-0dd1-4c0a-9326-561730574f57 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:57.035519 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-62e7cfa2-0dd1-4c0a-9326-561730574f57 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:57.162829 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ca81892c-0d55-4b34-82d2-f67bdd6ffc1c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:57.163433 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ca81892c-0d55-4b34-82d2-f67bdd6ffc1c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:57.171545 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca81892c-0d55-4b34-82d2-f67bdd6ffc1c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:57.172655 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca81892c-0d55-4b34-82d2-f67bdd6ffc1c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:57.173997 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca81892c-0d55-4b34-82d2-f67bdd6ffc1c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:57.175303 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca81892c-0d55-4b34-82d2-f67bdd6ffc1c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:57.185447 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-62e7cfa2-0dd1-4c0a-9326-561730574f57 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:57.193603 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-62e7cfa2-0dd1-4c0a-9326-561730574f57 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.172433 Oct 28 12:12:57.194620 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 53/101] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:57 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:57.249170 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ca81892c-0d55-4b34-82d2-f67bdd6ffc1c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:57.258626 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ca81892c-0d55-4b34-82d2-f67bdd6ffc1c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:57.260472 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ca81892c-0d55-4b34-82d2-f67bdd6ffc1c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:57.261614 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ca81892c-0d55-4b34-82d2-f67bdd6ffc1c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1285 microversion: 2.20 time: 0.102471 Oct 28 12:12:57.262499 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 49/102] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:12:57 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:12:57.360763 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-570ef821-7b48-4a3b-bfc0-9cf65598f9e9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:57.361540 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-570ef821-7b48-4a3b-bfc0-9cf65598f9e9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:57.368698 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-570ef821-7b48-4a3b-bfc0-9cf65598f9e9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:57.369143 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-570ef821-7b48-4a3b-bfc0-9cf65598f9e9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:57.369913 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-570ef821-7b48-4a3b-bfc0-9cf65598f9e9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:57.370339 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-570ef821-7b48-4a3b-bfc0-9cf65598f9e9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:57.525729 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-570ef821-7b48-4a3b-bfc0-9cf65598f9e9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:57.533231 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-570ef821-7b48-4a3b-bfc0-9cf65598f9e9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.177334 Oct 28 12:12:57.534355 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 54/103] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:57 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:12:57.844867 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9fa7bfc6-c93e-4ca4-a601-a8535211871e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:57.845551 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9fa7bfc6-c93e-4ca4-a601-a8535211871e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:57.852484 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9fa7bfc6-c93e-4ca4-a601-a8535211871e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:57.853054 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9fa7bfc6-c93e-4ca4-a601-a8535211871e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:57.853965 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9fa7bfc6-c93e-4ca4-a601-a8535211871e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:57.854573 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9fa7bfc6-c93e-4ca4-a601-a8535211871e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:57.920189 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9fa7bfc6-c93e-4ca4-a601-a8535211871e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:57.928585 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9fa7bfc6-c93e-4ca4-a601-a8535211871e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1218 microversion: 2.1 time: 0.087231 Oct 28 12:12:57.929414 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 50/104] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:57 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:58.211628 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e4a7d5b0-1191-4e3d-97af-1f87fc29f9d9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:58.212206 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e4a7d5b0-1191-4e3d-97af-1f87fc29f9d9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:58.219258 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e4a7d5b0-1191-4e3d-97af-1f87fc29f9d9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:58.219701 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e4a7d5b0-1191-4e3d-97af-1f87fc29f9d9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:58.220475 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e4a7d5b0-1191-4e3d-97af-1f87fc29f9d9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:58.220934 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e4a7d5b0-1191-4e3d-97af-1f87fc29f9d9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:58.280629 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-71c9a164-121c-4a5a-82ce-d78918c40a45 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:58.281346 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-71c9a164-121c-4a5a-82ce-d78918c40a45 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:58.287391 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-71c9a164-121c-4a5a-82ce-d78918c40a45 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:58.287924 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-71c9a164-121c-4a5a-82ce-d78918c40a45 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:58.288786 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-71c9a164-121c-4a5a-82ce-d78918c40a45 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:58.289456 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-71c9a164-121c-4a5a-82ce-d78918c40a45 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:58.352279 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-71c9a164-121c-4a5a-82ce-d78918c40a45 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:58.360809 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-71c9a164-121c-4a5a-82ce-d78918c40a45 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:58.362307 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-71c9a164-121c-4a5a-82ce-d78918c40a45 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:58.363565 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-71c9a164-121c-4a5a-82ce-d78918c40a45 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1277 microversion: 2.20 time: 0.086695 Oct 28 12:12:58.364126 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 51/105] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:12:58 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:12:58.551522 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-83693de0-6e8b-4774-9259-4e27a8226d45 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:58.552214 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-83693de0-6e8b-4774-9259-4e27a8226d45 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:58.559614 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-83693de0-6e8b-4774-9259-4e27a8226d45 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:58.560063 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-83693de0-6e8b-4774-9259-4e27a8226d45 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:58.560847 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-83693de0-6e8b-4774-9259-4e27a8226d45 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:58.561277 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-83693de0-6e8b-4774-9259-4e27a8226d45 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:58.712641 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-83693de0-6e8b-4774-9259-4e27a8226d45 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:58.722044 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-83693de0-6e8b-4774-9259-4e27a8226d45 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.174549 Oct 28 12:12:58.723031 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 52/106] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:58 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:12:58.765839 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e4a7d5b0-1191-4e3d-97af-1f87fc29f9d9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:58.773826 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e4a7d5b0-1191-4e3d-97af-1f87fc29f9d9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.565923 Oct 28 12:12:58.774410 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 55/107] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:58 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:58.950739 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d47b0e2e-1a4b-446d-928d-5e6640ac41f7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:58.951352 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d47b0e2e-1a4b-446d-928d-5e6640ac41f7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:58.958424 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d47b0e2e-1a4b-446d-928d-5e6640ac41f7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:58.958944 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d47b0e2e-1a4b-446d-928d-5e6640ac41f7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:58.960202 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d47b0e2e-1a4b-446d-928d-5e6640ac41f7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:58.960660 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d47b0e2e-1a4b-446d-928d-5e6640ac41f7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:59.034954 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d47b0e2e-1a4b-446d-928d-5e6640ac41f7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:59.041341 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d47b0e2e-1a4b-446d-928d-5e6640ac41f7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1218 microversion: 2.1 time: 0.098063 Oct 28 12:12:59.041920 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 53/108] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:58 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:59.381354 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6aeda400-10aa-49ea-877d-e9438e5a57f7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:59.381953 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6aeda400-10aa-49ea-877d-e9438e5a57f7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:59.387936 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6aeda400-10aa-49ea-877d-e9438e5a57f7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:59.388379 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6aeda400-10aa-49ea-877d-e9438e5a57f7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:59.389135 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6aeda400-10aa-49ea-877d-e9438e5a57f7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:59.389561 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6aeda400-10aa-49ea-877d-e9438e5a57f7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:59.505966 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6aeda400-10aa-49ea-877d-e9438e5a57f7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:59.513962 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6aeda400-10aa-49ea-877d-e9438e5a57f7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:59.515584 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6aeda400-10aa-49ea-877d-e9438e5a57f7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:59.516735 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6aeda400-10aa-49ea-877d-e9438e5a57f7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1277 microversion: 2.20 time: 0.139166 Oct 28 12:12:59.518066 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 56/109] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:12:59 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1277 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:12:59.608251 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-1c27a942-9d99-4b03-94b8-18572abb6ec5 req-f1a6e864-0c48-4412-bb5d-8f07d2be5599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e8e6f3a-3f05-49d7-b1d4-b714a4382010", "tag": "9150fd45-c84d-4736-a6a2-8247b4b15dda"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:12:59.610426 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:12:59.610426 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:12:59.620386 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-1c27a942-9d99-4b03-94b8-18572abb6ec5 req-f1a6e864-0c48-4412-bb5d-8f07d2be5599 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:59.620815 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-1c27a942-9d99-4b03-94b8-18572abb6ec5 req-f1a6e864-0c48-4412-bb5d-8f07d2be5599 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:59.639356 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-1c27a942-9d99-4b03-94b8-18572abb6ec5 req-f1a6e864-0c48-4412-bb5d-8f07d2be5599 service nova] Creating event network-changed:9150fd45-c84d-4736-a6a2-8247b4b15dda for instance 0e8e6f3a-3f05-49d7-b1d4-b714a4382010 on hv-cinder-81571 Oct 28 12:12:59.639850 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-1c27a942-9d99-4b03-94b8-18572abb6ec5 req-f1a6e864-0c48-4412-bb5d-8f07d2be5599 service nova] Acquired lock "compute-rpcapi-router" {{(pid=115797) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 28 12:12:59.640934 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d389957-f805-4b2e-9f9f-598fbc398cc2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:59.641358 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d389957-f805-4b2e-9f9f-598fbc398cc2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:59.642128 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d389957-f805-4b2e-9f9f-598fbc398cc2 None None] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:59.642542 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d389957-f805-4b2e-9f9f-598fbc398cc2 None None] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:59.651547 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.compute.rpcapi [None req-5d389957-f805-4b2e-9f9f-598fbc398cc2 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 28 12:12:59.652400 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d389957-f805-4b2e-9f9f-598fbc398cc2 None None] Releasing lock "compute-rpcapi-router" {{(pid=115797) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 28 12:12:59.677093 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5d389957-f805-4b2e-9f9f-598fbc398cc2 None None] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131746 Oct 28 12:12:59.677851 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 54/110] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:12:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:12:59.738738 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6743798f-0549-4246-a863-0866489d439b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:59.739366 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6743798f-0549-4246-a863-0866489d439b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:59.745432 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6743798f-0549-4246-a863-0866489d439b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:59.745867 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6743798f-0549-4246-a863-0866489d439b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:59.746635 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6743798f-0549-4246-a863-0866489d439b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:59.747093 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6743798f-0549-4246-a863-0866489d439b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:59.791360 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0c5984aa-2cbc-4c6b-b39d-207bfd268e41 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:12:59.792190 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0c5984aa-2cbc-4c6b-b39d-207bfd268e41 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:12:59.799278 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0c5984aa-2cbc-4c6b-b39d-207bfd268e41 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:59.799720 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0c5984aa-2cbc-4c6b-b39d-207bfd268e41 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:59.800503 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0c5984aa-2cbc-4c6b-b39d-207bfd268e41 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:12:59.800927 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0c5984aa-2cbc-4c6b-b39d-207bfd268e41 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:12:59.875937 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6743798f-0549-4246-a863-0866489d439b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:59.883768 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6743798f-0549-4246-a863-0866489d439b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.148697 Oct 28 12:12:59.884664 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 57/111] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:59 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:12:59.928235 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0c5984aa-2cbc-4c6b-b39d-207bfd268e41 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:12:59.935588 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0c5984aa-2cbc-4c6b-b39d-207bfd268e41 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.148481 Oct 28 12:12:59.936277 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 55/112] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:12:59 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:00.058315 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-762ab2b6-322e-41c5-b997-34ee7f300009 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:00.059010 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-762ab2b6-322e-41c5-b997-34ee7f300009 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:00.064656 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-762ab2b6-322e-41c5-b997-34ee7f300009 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:00.065264 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-762ab2b6-322e-41c5-b997-34ee7f300009 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:00.066761 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-762ab2b6-322e-41c5-b997-34ee7f300009 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:00.067185 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-762ab2b6-322e-41c5-b997-34ee7f300009 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:00.124411 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-762ab2b6-322e-41c5-b997-34ee7f300009 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:00.132814 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-762ab2b6-322e-41c5-b997-34ee7f300009 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1218 microversion: 2.1 time: 0.078025 Oct 28 12:13:00.133391 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 58/113] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:00 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:00.536604 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-68183757-cd5b-4edf-b801-071671360921 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:00.537213 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-68183757-cd5b-4edf-b801-071671360921 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:00.543219 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-68183757-cd5b-4edf-b801-071671360921 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:00.543664 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-68183757-cd5b-4edf-b801-071671360921 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:00.544432 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-68183757-cd5b-4edf-b801-071671360921 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:00.544868 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-68183757-cd5b-4edf-b801-071671360921 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:00.605612 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-68183757-cd5b-4edf-b801-071671360921 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:00.614030 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-68183757-cd5b-4edf-b801-071671360921 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:00.615668 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-68183757-cd5b-4edf-b801-071671360921 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:00.616754 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-68183757-cd5b-4edf-b801-071671360921 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1277 microversion: 2.20 time: 0.084428 Oct 28 12:13:00.617306 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 56/114] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:00 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:13:00.900772 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f56962a1-f66e-48f4-bf6f-4ef0277ecab7 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:00.901379 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f56962a1-f66e-48f4-bf6f-4ef0277ecab7 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:00.907278 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f56962a1-f66e-48f4-bf6f-4ef0277ecab7 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:00.907722 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f56962a1-f66e-48f4-bf6f-4ef0277ecab7 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:00.908490 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f56962a1-f66e-48f4-bf6f-4ef0277ecab7 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:00.909609 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f56962a1-f66e-48f4-bf6f-4ef0277ecab7 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:00.953121 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b84d4d85-ce0d-4fe2-9659-22918d81e6b8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:00.954076 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b84d4d85-ce0d-4fe2-9659-22918d81e6b8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:00.960828 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b84d4d85-ce0d-4fe2-9659-22918d81e6b8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:00.961402 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b84d4d85-ce0d-4fe2-9659-22918d81e6b8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:00.962283 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b84d4d85-ce0d-4fe2-9659-22918d81e6b8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:00.962858 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b84d4d85-ce0d-4fe2-9659-22918d81e6b8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:01.033163 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f56962a1-f66e-48f4-bf6f-4ef0277ecab7 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:01.041712 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f56962a1-f66e-48f4-bf6f-4ef0277ecab7 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.144491 Oct 28 12:13:01.042290 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 59/115] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:00 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:01.086380 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b84d4d85-ce0d-4fe2-9659-22918d81e6b8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:01.093887 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b84d4d85-ce0d-4fe2-9659-22918d81e6b8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.144701 Oct 28 12:13:01.094461 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 57/116] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:00 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:01.149800 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b13790fc-ca0a-4e35-b1db-e1dd491543d0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:01.150391 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b13790fc-ca0a-4e35-b1db-e1dd491543d0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:01.156228 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b13790fc-ca0a-4e35-b1db-e1dd491543d0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:01.156669 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b13790fc-ca0a-4e35-b1db-e1dd491543d0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:01.157464 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b13790fc-ca0a-4e35-b1db-e1dd491543d0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:01.157885 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b13790fc-ca0a-4e35-b1db-e1dd491543d0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:01.221471 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b13790fc-ca0a-4e35-b1db-e1dd491543d0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:01.229191 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b13790fc-ca0a-4e35-b1db-e1dd491543d0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1218 microversion: 2.1 time: 0.082936 Oct 28 12:13:01.229818 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 60/117] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:01 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:01.635074 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-070314b2-2527-4791-a1ec-6f18dc2f418d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:01.636436 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-070314b2-2527-4791-a1ec-6f18dc2f418d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:01.644031 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-070314b2-2527-4791-a1ec-6f18dc2f418d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:01.644711 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-070314b2-2527-4791-a1ec-6f18dc2f418d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:01.645440 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-070314b2-2527-4791-a1ec-6f18dc2f418d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:01.645863 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-070314b2-2527-4791-a1ec-6f18dc2f418d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:01.717486 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-96d2a396-3410-447e-97d3-8440d587accc req-0282ff76-c58c-46e1-ae2c-f98594b29469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be58a22-3717-40ff-bd99-40e4eb31b6e8", "tag": "5e44939b-7777-4875-ae6d-f2d700df9c88"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:01.719693 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:13:01.719693 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:13:01.730991 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-96d2a396-3410-447e-97d3-8440d587accc req-0282ff76-c58c-46e1-ae2c-f98594b29469 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:01.731811 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-96d2a396-3410-447e-97d3-8440d587accc req-0282ff76-c58c-46e1-ae2c-f98594b29469 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:01.742802 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-070314b2-2527-4791-a1ec-6f18dc2f418d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:01.755408 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-96d2a396-3410-447e-97d3-8440d587accc req-0282ff76-c58c-46e1-ae2c-f98594b29469 service nova] Creating event network-changed:5e44939b-7777-4875-ae6d-f2d700df9c88 for instance 2be58a22-3717-40ff-bd99-40e4eb31b6e8 on hv-cinder-81571 Oct 28 12:13:01.756223 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-96d2a396-3410-447e-97d3-8440d587accc req-0282ff76-c58c-46e1-ae2c-f98594b29469 service nova] Acquired lock "compute-rpcapi-router" {{(pid=115798) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 28 12:13:01.757552 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e50f9563-3220-4be1-8f44-22abeb4038c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:01.758181 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e50f9563-3220-4be1-8f44-22abeb4038c4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:01.760485 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e50f9563-3220-4be1-8f44-22abeb4038c4 None None] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:01.761195 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e50f9563-3220-4be1-8f44-22abeb4038c4 None None] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:01.771308 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.compute.rpcapi [None req-e50f9563-3220-4be1-8f44-22abeb4038c4 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 28 12:13:01.773271 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e50f9563-3220-4be1-8f44-22abeb4038c4 None None] Releasing lock "compute-rpcapi-router" {{(pid=115798) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 28 12:13:01.781513 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-070314b2-2527-4791-a1ec-6f18dc2f418d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:01.784970 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-070314b2-2527-4791-a1ec-6f18dc2f418d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:01.787196 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-070314b2-2527-4791-a1ec-6f18dc2f418d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1277 microversion: 2.20 time: 0.156492 Oct 28 12:13:01.789818 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 58/118] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:01 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:13:01.812049 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e50f9563-3220-4be1-8f44-22abeb4038c4 None None] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097966 Oct 28 12:13:01.812818 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 61/119] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:13:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:13:02.059580 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5e397b8a-2069-4600-93e5-462774b0cf05 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:02.060313 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5e397b8a-2069-4600-93e5-462774b0cf05 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:02.067871 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e397b8a-2069-4600-93e5-462774b0cf05 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:02.068445 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e397b8a-2069-4600-93e5-462774b0cf05 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:02.069433 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e397b8a-2069-4600-93e5-462774b0cf05 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:02.069973 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e397b8a-2069-4600-93e5-462774b0cf05 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:02.112687 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fb66353f-0965-4e7a-8413-707affbaccfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:02.114213 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fb66353f-0965-4e7a-8413-707affbaccfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:02.121560 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fb66353f-0965-4e7a-8413-707affbaccfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:02.122497 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fb66353f-0965-4e7a-8413-707affbaccfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:02.123539 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fb66353f-0965-4e7a-8413-707affbaccfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:02.124178 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fb66353f-0965-4e7a-8413-707affbaccfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:02.407005 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5e397b8a-2069-4600-93e5-462774b0cf05 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:02.415901 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5e397b8a-2069-4600-93e5-462774b0cf05 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.359864 Oct 28 12:13:02.418089 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 59/120] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:02 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:02.423483 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b40c6a3b-7c8f-45d9-89cb-625189413e1d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:02.425472 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b40c6a3b-7c8f-45d9-89cb-625189413e1d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:02.440555 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b40c6a3b-7c8f-45d9-89cb-625189413e1d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:02.441340 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b40c6a3b-7c8f-45d9-89cb-625189413e1d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:02.442119 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b40c6a3b-7c8f-45d9-89cb-625189413e1d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:02.442579 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b40c6a3b-7c8f-45d9-89cb-625189413e1d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:02.488864 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fb66353f-0965-4e7a-8413-707affbaccfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:02.496319 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fb66353f-0965-4e7a-8413-707affbaccfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.388140 Oct 28 12:13:02.506765 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 62/121] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:02 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:02.510410 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b40c6a3b-7c8f-45d9-89cb-625189413e1d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:02.518442 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b40c6a3b-7c8f-45d9-89cb-625189413e1d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1280 microversion: 2.1 time: 0.098677 Oct 28 12:13:02.527885 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 60/122] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:02 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1280 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:02.812921 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-67a62b70-c19d-4c44-9970-40eb5c720e09 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:02.813542 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-67a62b70-c19d-4c44-9970-40eb5c720e09 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:02.824258 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-67a62b70-c19d-4c44-9970-40eb5c720e09 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:02.825082 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-67a62b70-c19d-4c44-9970-40eb5c720e09 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:02.826347 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-67a62b70-c19d-4c44-9970-40eb5c720e09 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:02.827003 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-67a62b70-c19d-4c44-9970-40eb5c720e09 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:02.964229 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-67a62b70-c19d-4c44-9970-40eb5c720e09 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:02.973393 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-67a62b70-c19d-4c44-9970-40eb5c720e09 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:02.988811 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-67a62b70-c19d-4c44-9970-40eb5c720e09 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:02.993302 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-67a62b70-c19d-4c44-9970-40eb5c720e09 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1333 microversion: 2.20 time: 0.187831 Oct 28 12:13:02.996049 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 63/123] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:02 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1333 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:13:03.435280 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1f46b72c-8e3d-4f87-b167-2b169e7abce6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:03.435825 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1f46b72c-8e3d-4f87-b167-2b169e7abce6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:03.445691 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1f46b72c-8e3d-4f87-b167-2b169e7abce6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:03.446145 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1f46b72c-8e3d-4f87-b167-2b169e7abce6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:03.457522 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1f46b72c-8e3d-4f87-b167-2b169e7abce6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:03.457522 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1f46b72c-8e3d-4f87-b167-2b169e7abce6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:03.514457 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-70ce7b3e-e7e0-4856-877b-58e5a65133f7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:03.516277 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-70ce7b3e-e7e0-4856-877b-58e5a65133f7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:03.546841 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70ce7b3e-e7e0-4856-877b-58e5a65133f7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:03.547438 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70ce7b3e-e7e0-4856-877b-58e5a65133f7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:03.548327 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70ce7b3e-e7e0-4856-877b-58e5a65133f7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:03.548776 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70ce7b3e-e7e0-4856-877b-58e5a65133f7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:04.024165 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-70ce7b3e-e7e0-4856-877b-58e5a65133f7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:04.036877 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-70ce7b3e-e7e0-4856-877b-58e5a65133f7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.526506 Oct 28 12:13:04.037874 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 64/124] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:03 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:04.047356 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1f46b72c-8e3d-4f87-b167-2b169e7abce6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:04.048140 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1f46b72c-8e3d-4f87-b167-2b169e7abce6 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.617512 Oct 28 12:13:04.059705 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 61/125] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:03 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:04.059705 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4c6c8b84-5521-4937-b3ea-7085f13a5766 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:04.059705 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4c6c8b84-5521-4937-b3ea-7085f13a5766 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:04.064454 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a7117af4-e68c-49d5-8d42-a8501d5b9b0e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:04.065694 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a7117af4-e68c-49d5-8d42-a8501d5b9b0e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:04.073832 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4c6c8b84-5521-4937-b3ea-7085f13a5766 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:04.074205 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4c6c8b84-5521-4937-b3ea-7085f13a5766 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:04.075062 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4c6c8b84-5521-4937-b3ea-7085f13a5766 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:04.075491 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4c6c8b84-5521-4937-b3ea-7085f13a5766 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:04.076007 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a7117af4-e68c-49d5-8d42-a8501d5b9b0e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:04.076672 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a7117af4-e68c-49d5-8d42-a8501d5b9b0e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:04.078135 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a7117af4-e68c-49d5-8d42-a8501d5b9b0e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:04.078828 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a7117af4-e68c-49d5-8d42-a8501d5b9b0e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:04.224751 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a7117af4-e68c-49d5-8d42-a8501d5b9b0e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:04.238411 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a7117af4-e68c-49d5-8d42-a8501d5b9b0e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1280 microversion: 2.1 time: 0.188435 Oct 28 12:13:04.239816 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 65/126] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:04 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1280 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:04.256266 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4c6c8b84-5521-4937-b3ea-7085f13a5766 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:04.264772 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4c6c8b84-5521-4937-b3ea-7085f13a5766 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:04.292212 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4c6c8b84-5521-4937-b3ea-7085f13a5766 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:04.293462 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4c6c8b84-5521-4937-b3ea-7085f13a5766 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1339 microversion: 2.20 time: 0.240750 Oct 28 12:13:04.307188 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 62/127] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:04 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1339 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:13:05.060440 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-94f73aa0-0888-4f52-8cdd-35f93a67d8a7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:05.063279 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-94f73aa0-0888-4f52-8cdd-35f93a67d8a7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:05.069315 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fedee88f-c77e-4d97-855b-ca06397cab27 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:05.070884 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fedee88f-c77e-4d97-855b-ca06397cab27 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:05.083468 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fedee88f-c77e-4d97-855b-ca06397cab27 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:05.084608 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fedee88f-c77e-4d97-855b-ca06397cab27 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:05.087285 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fedee88f-c77e-4d97-855b-ca06397cab27 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:05.087963 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fedee88f-c77e-4d97-855b-ca06397cab27 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:05.106988 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-94f73aa0-0888-4f52-8cdd-35f93a67d8a7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:05.111754 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-94f73aa0-0888-4f52-8cdd-35f93a67d8a7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:05.117174 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-94f73aa0-0888-4f52-8cdd-35f93a67d8a7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:05.118382 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-94f73aa0-0888-4f52-8cdd-35f93a67d8a7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:05.557886 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fedee88f-c77e-4d97-855b-ca06397cab27 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:05.566765 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fedee88f-c77e-4d97-855b-ca06397cab27 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.502972 Oct 28 12:13:05.581394 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 63/128] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:05 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:05.597886 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d9b2699b-b844-41cd-a197-b876587fd018 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:05.600372 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d9b2699b-b844-41cd-a197-b876587fd018 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:05.624243 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d9b2699b-b844-41cd-a197-b876587fd018 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:05.625193 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d9b2699b-b844-41cd-a197-b876587fd018 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:05.626231 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d9b2699b-b844-41cd-a197-b876587fd018 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:05.626903 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d9b2699b-b844-41cd-a197-b876587fd018 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:05.890105 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-94f73aa0-0888-4f52-8cdd-35f93a67d8a7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:05.900338 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-94f73aa0-0888-4f52-8cdd-35f93a67d8a7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.847968 Oct 28 12:13:05.901627 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 66/129] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:05 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:05.912416 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2c0efdcf-c19f-4165-9330-f66f8d3f36e6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:05.913134 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2c0efdcf-c19f-4165-9330-f66f8d3f36e6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:05.920631 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2c0efdcf-c19f-4165-9330-f66f8d3f36e6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:05.921202 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2c0efdcf-c19f-4165-9330-f66f8d3f36e6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:05.922596 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2c0efdcf-c19f-4165-9330-f66f8d3f36e6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:05.923315 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2c0efdcf-c19f-4165-9330-f66f8d3f36e6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:06.201731 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d9b2699b-b844-41cd-a197-b876587fd018 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:06.212507 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d9b2699b-b844-41cd-a197-b876587fd018 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.628219 Oct 28 12:13:06.213382 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 64/130] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:05 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:06.227242 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-a85bdc00-afd3-4220-a369-a16c5d692b19 req-f718c7fe-7bd8-4ba5-824d-07293e782ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28b1cf11-e525-409b-83da-1c26e1d9937d", "tag": "7fffbbcb-b6ac-4854-853b-b69ac56c5812"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:06.229588 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:13:06.229588 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:13:06.239702 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-a85bdc00-afd3-4220-a369-a16c5d692b19 req-f718c7fe-7bd8-4ba5-824d-07293e782ee2 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:06.240433 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-a85bdc00-afd3-4220-a369-a16c5d692b19 req-f718c7fe-7bd8-4ba5-824d-07293e782ee2 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:06.259390 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-a85bdc00-afd3-4220-a369-a16c5d692b19 req-f718c7fe-7bd8-4ba5-824d-07293e782ee2 service nova] Creating event network-changed:7fffbbcb-b6ac-4854-853b-b69ac56c5812 for instance 28b1cf11-e525-409b-83da-1c26e1d9937d on hv-cinder-81571 Oct 28 12:13:06.259643 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2c0efdcf-c19f-4165-9330-f66f8d3f36e6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:06.266900 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-a85bdc00-afd3-4220-a369-a16c5d692b19 req-f718c7fe-7bd8-4ba5-824d-07293e782ee2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051872 Oct 28 12:13:06.268058 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 65/131] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:13:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:13:06.281648 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2c0efdcf-c19f-4165-9330-f66f8d3f36e6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:06.292780 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2c0efdcf-c19f-4165-9330-f66f8d3f36e6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:06.294395 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2c0efdcf-c19f-4165-9330-f66f8d3f36e6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1407 microversion: 2.20 time: 0.391258 Oct 28 12:13:06.296841 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 67/132] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:05 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1407 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:13:06.589695 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4e56d77e-2669-401a-8abc-d25e8c4ff1a3 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:06.590399 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4e56d77e-2669-401a-8abc-d25e8c4ff1a3 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:06.599941 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4e56d77e-2669-401a-8abc-d25e8c4ff1a3 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:06.600852 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4e56d77e-2669-401a-8abc-d25e8c4ff1a3 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:06.601952 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4e56d77e-2669-401a-8abc-d25e8c4ff1a3 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:06.602462 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4e56d77e-2669-401a-8abc-d25e8c4ff1a3 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:06.918480 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9a3fa9e7-7bd4-47bc-95b6-8227d1471853 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:06.919277 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9a3fa9e7-7bd4-47bc-95b6-8227d1471853 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:06.935018 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9a3fa9e7-7bd4-47bc-95b6-8227d1471853 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:06.935687 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9a3fa9e7-7bd4-47bc-95b6-8227d1471853 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:06.938102 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9a3fa9e7-7bd4-47bc-95b6-8227d1471853 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:06.941526 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9a3fa9e7-7bd4-47bc-95b6-8227d1471853 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:07.273877 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4e56d77e-2669-401a-8abc-d25e8c4ff1a3 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:07.296237 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4e56d77e-2669-401a-8abc-d25e8c4ff1a3 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.711283 Oct 28 12:13:07.308405 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 66/133] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:06 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:07.313142 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4aaa73f5-6c8d-4926-be9f-baaec6332f87 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:07.313968 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4aaa73f5-6c8d-4926-be9f-baaec6332f87 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:07.322458 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4aaa73f5-6c8d-4926-be9f-baaec6332f87 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:07.323176 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4aaa73f5-6c8d-4926-be9f-baaec6332f87 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:07.325035 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4aaa73f5-6c8d-4926-be9f-baaec6332f87 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:07.325632 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4aaa73f5-6c8d-4926-be9f-baaec6332f87 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:07.678352 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4aaa73f5-6c8d-4926-be9f-baaec6332f87 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:07.689041 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4aaa73f5-6c8d-4926-be9f-baaec6332f87 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.379398 Oct 28 12:13:07.692024 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 67/134] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:07 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:07.701979 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-052bacd1-d840-4dc0-a63f-7a90752632b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:07.705206 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-052bacd1-d840-4dc0-a63f-7a90752632b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:07.720614 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-052bacd1-d840-4dc0-a63f-7a90752632b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:07.721529 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-052bacd1-d840-4dc0-a63f-7a90752632b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:07.723656 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-052bacd1-d840-4dc0-a63f-7a90752632b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:07.724892 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-052bacd1-d840-4dc0-a63f-7a90752632b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:07.739109 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9a3fa9e7-7bd4-47bc-95b6-8227d1471853 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:07.759107 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9a3fa9e7-7bd4-47bc-95b6-8227d1471853 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.845346 Oct 28 12:13:07.760033 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 68/135] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:06 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:08.001184 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-301648c8-2d51-48cc-8ed4-3e3020eaa4be req-50c5d3ea-0aa7-4b83-b130-8af918bd2b7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c85f2863-bf90-49f5-a7cb-a13e366f1a0d", "tag": "44584889-faf9-46d2-a381-15ee8d86d81a"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:08.003765 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:13:08.003765 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:13:08.015298 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-301648c8-2d51-48cc-8ed4-3e3020eaa4be req-50c5d3ea-0aa7-4b83-b130-8af918bd2b7f service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:08.017955 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-301648c8-2d51-48cc-8ed4-3e3020eaa4be req-50c5d3ea-0aa7-4b83-b130-8af918bd2b7f service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:08.044551 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-301648c8-2d51-48cc-8ed4-3e3020eaa4be req-50c5d3ea-0aa7-4b83-b130-8af918bd2b7f service nova] Creating event network-changed:44584889-faf9-46d2-a381-15ee8d86d81a for instance c85f2863-bf90-49f5-a7cb-a13e366f1a0d on hv-cinder-81571 Oct 28 12:13:08.060992 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-301648c8-2d51-48cc-8ed4-3e3020eaa4be req-50c5d3ea-0aa7-4b83-b130-8af918bd2b7f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.298885 Oct 28 12:13:08.065700 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 69/136] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:13:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:13:08.292024 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-052bacd1-d840-4dc0-a63f-7a90752632b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:08.293025 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-35ef2e3f-4a99-44fd-94a0-bc92b41102a2 req-5a8c46ea-955d-4923-bf55-704d1a2291c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d79ab524-bc96-45ce-91df-6713d6fcaaaf", "tag": "f783de9c-03e4-446f-b34b-e2edaa551d3c"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:08.295063 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:13:08.295063 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:13:08.313549 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-35ef2e3f-4a99-44fd-94a0-bc92b41102a2 req-5a8c46ea-955d-4923-bf55-704d1a2291c4 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:08.313989 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-35ef2e3f-4a99-44fd-94a0-bc92b41102a2 req-5a8c46ea-955d-4923-bf55-704d1a2291c4 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:08.315526 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-052bacd1-d840-4dc0-a63f-7a90752632b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:08.322828 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-052bacd1-d840-4dc0-a63f-7a90752632b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:08.325942 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-35ef2e3f-4a99-44fd-94a0-bc92b41102a2 req-5a8c46ea-955d-4923-bf55-704d1a2291c4 service nova] Creating event network-changed:f783de9c-03e4-446f-b34b-e2edaa551d3c for instance d79ab524-bc96-45ce-91df-6713d6fcaaaf on hv-cinder-81571 Oct 28 12:13:08.332621 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-35ef2e3f-4a99-44fd-94a0-bc92b41102a2 req-5a8c46ea-955d-4923-bf55-704d1a2291c4 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044356 Oct 28 12:13:08.333802 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 70/137] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:13:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:13:08.344042 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-052bacd1-d840-4dc0-a63f-7a90752632b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1407 microversion: 2.20 time: 0.640528 Oct 28 12:13:08.344042 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 68/138] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:07 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1407 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:13:08.350375 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d95fc3ad-2f15-471e-83ca-3233352b0143 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:08.351361 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d95fc3ad-2f15-471e-83ca-3233352b0143 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:08.359110 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d95fc3ad-2f15-471e-83ca-3233352b0143 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:08.359561 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d95fc3ad-2f15-471e-83ca-3233352b0143 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:08.360402 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d95fc3ad-2f15-471e-83ca-3233352b0143 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:08.361297 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d95fc3ad-2f15-471e-83ca-3233352b0143 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:08.714943 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-741701c6-1154-4057-8e69-87fd0fa4244c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:08.716258 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-741701c6-1154-4057-8e69-87fd0fa4244c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:08.723045 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d95fc3ad-2f15-471e-83ca-3233352b0143 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:08.756296 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d95fc3ad-2f15-471e-83ca-3233352b0143 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.420767 Oct 28 12:13:08.763889 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-741701c6-1154-4057-8e69-87fd0fa4244c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:08.767185 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-741701c6-1154-4057-8e69-87fd0fa4244c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:08.767632 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 71/139] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:08 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:08.768571 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-741701c6-1154-4057-8e69-87fd0fa4244c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:08.769226 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-741701c6-1154-4057-8e69-87fd0fa4244c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:08.778326 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-69957bba-52a7-4dc5-91c8-891c9c8febcd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:08.780009 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-69957bba-52a7-4dc5-91c8-891c9c8febcd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:08.791724 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69957bba-52a7-4dc5-91c8-891c9c8febcd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:08.793650 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69957bba-52a7-4dc5-91c8-891c9c8febcd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:08.797847 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69957bba-52a7-4dc5-91c8-891c9c8febcd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:08.798663 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69957bba-52a7-4dc5-91c8-891c9c8febcd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:09.118781 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-741701c6-1154-4057-8e69-87fd0fa4244c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:09.136203 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-741701c6-1154-4057-8e69-87fd0fa4244c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.430350 Oct 28 12:13:09.141709 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 69/140] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:08 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:09.364415 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e627b436-10f8-43ef-9dfc-fd17b7b324b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:09.365077 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e627b436-10f8-43ef-9dfc-fd17b7b324b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:09.377545 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e627b436-10f8-43ef-9dfc-fd17b7b324b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:09.381413 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e627b436-10f8-43ef-9dfc-fd17b7b324b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:09.383526 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e627b436-10f8-43ef-9dfc-fd17b7b324b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:09.387141 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e627b436-10f8-43ef-9dfc-fd17b7b324b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:09.434145 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-69957bba-52a7-4dc5-91c8-891c9c8febcd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:09.446620 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-69957bba-52a7-4dc5-91c8-891c9c8febcd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.672132 Oct 28 12:13:09.448263 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 72/141] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:08 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:09.699476 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e627b436-10f8-43ef-9dfc-fd17b7b324b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:09.708216 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e627b436-10f8-43ef-9dfc-fd17b7b324b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:09.711870 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e627b436-10f8-43ef-9dfc-fd17b7b324b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:09.715185 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e627b436-10f8-43ef-9dfc-fd17b7b324b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1407 microversion: 2.20 time: 0.357035 Oct 28 12:13:09.723223 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 70/142] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:09 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1407 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:13:09.773252 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-38a5da8e-0274-475d-b131-02da2e3d0fc4 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:09.774916 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-38a5da8e-0274-475d-b131-02da2e3d0fc4 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:09.787784 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-38a5da8e-0274-475d-b131-02da2e3d0fc4 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:09.788986 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-38a5da8e-0274-475d-b131-02da2e3d0fc4 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:09.791998 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-38a5da8e-0274-475d-b131-02da2e3d0fc4 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:09.793311 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-38a5da8e-0274-475d-b131-02da2e3d0fc4 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:09.970302 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-38a5da8e-0274-475d-b131-02da2e3d0fc4 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:09.980458 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-38a5da8e-0274-475d-b131-02da2e3d0fc4 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.210769 Oct 28 12:13:09.990989 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 73/143] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:09 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:10.159397 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4cb3853a-33e3-4ca9-a74c-ecc621785b50 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:10.160552 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4cb3853a-33e3-4ca9-a74c-ecc621785b50 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:10.171693 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4cb3853a-33e3-4ca9-a74c-ecc621785b50 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:10.172513 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4cb3853a-33e3-4ca9-a74c-ecc621785b50 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:10.174794 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4cb3853a-33e3-4ca9-a74c-ecc621785b50 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:10.175740 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4cb3853a-33e3-4ca9-a74c-ecc621785b50 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:10.376074 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4cb3853a-33e3-4ca9-a74c-ecc621785b50 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:10.386226 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4cb3853a-33e3-4ca9-a74c-ecc621785b50 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.234094 Oct 28 12:13:10.386997 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 71/144] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:10 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:10.464775 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-23ab53e8-0187-42c1-bf70-81dfef15ab00 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:10.465377 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-23ab53e8-0187-42c1-bf70-81dfef15ab00 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:10.475196 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-23ab53e8-0187-42c1-bf70-81dfef15ab00 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:10.475728 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-23ab53e8-0187-42c1-bf70-81dfef15ab00 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:10.477261 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-23ab53e8-0187-42c1-bf70-81dfef15ab00 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:10.477788 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-23ab53e8-0187-42c1-bf70-81dfef15ab00 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:10.688230 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-23ab53e8-0187-42c1-bf70-81dfef15ab00 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:10.705611 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-23ab53e8-0187-42c1-bf70-81dfef15ab00 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.244880 Oct 28 12:13:10.707590 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 74/145] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:10 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:10.750012 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bb06c295-a406-4990-9b56-261aeb7b47dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:10.750777 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bb06c295-a406-4990-9b56-261aeb7b47dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:10.758042 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb06c295-a406-4990-9b56-261aeb7b47dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:10.758490 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb06c295-a406-4990-9b56-261aeb7b47dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:10.759332 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb06c295-a406-4990-9b56-261aeb7b47dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:10.759754 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb06c295-a406-4990-9b56-261aeb7b47dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:10.908104 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bb06c295-a406-4990-9b56-261aeb7b47dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:10.920204 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bb06c295-a406-4990-9b56-261aeb7b47dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:10.922374 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bb06c295-a406-4990-9b56-261aeb7b47dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:10.923600 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bb06c295-a406-4990-9b56-261aeb7b47dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1407 microversion: 2.20 time: 0.177869 Oct 28 12:13:10.935337 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 72/146] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:10 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:13:10.997279 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-94d17640-d125-44d2-a289-5d7578433185 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:10.997781 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-94d17640-d125-44d2-a289-5d7578433185 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:11.020813 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-94d17640-d125-44d2-a289-5d7578433185 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:11.021279 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-94d17640-d125-44d2-a289-5d7578433185 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:11.022074 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-94d17640-d125-44d2-a289-5d7578433185 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:11.022500 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-94d17640-d125-44d2-a289-5d7578433185 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:11.224049 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-94d17640-d125-44d2-a289-5d7578433185 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:11.232777 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-94d17640-d125-44d2-a289-5d7578433185 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.239259 Oct 28 12:13:11.235335 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 75/147] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:10 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:11.403797 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a2e7a39f-df6b-45ca-a1cb-b49fb2f4b87b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:11.404489 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a2e7a39f-df6b-45ca-a1cb-b49fb2f4b87b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:11.412510 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a2e7a39f-df6b-45ca-a1cb-b49fb2f4b87b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:11.412977 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a2e7a39f-df6b-45ca-a1cb-b49fb2f4b87b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:11.413777 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a2e7a39f-df6b-45ca-a1cb-b49fb2f4b87b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:11.414235 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a2e7a39f-df6b-45ca-a1cb-b49fb2f4b87b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:11.581453 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a2e7a39f-df6b-45ca-a1cb-b49fb2f4b87b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:11.589977 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a2e7a39f-df6b-45ca-a1cb-b49fb2f4b87b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.189864 Oct 28 12:13:11.591146 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 73/148] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:11 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:11.722644 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-257a30cc-cf83-40cd-bc56-e9fe9f1708ab tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:11.723247 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-257a30cc-cf83-40cd-bc56-e9fe9f1708ab tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:11.733932 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-257a30cc-cf83-40cd-bc56-e9fe9f1708ab tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:11.734908 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-257a30cc-cf83-40cd-bc56-e9fe9f1708ab tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:11.735963 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-257a30cc-cf83-40cd-bc56-e9fe9f1708ab tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:11.736472 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-257a30cc-cf83-40cd-bc56-e9fe9f1708ab tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:11.945177 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9d55120e-7915-4b7e-9d40-1d52bc3f2e95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:11.946037 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9d55120e-7915-4b7e-9d40-1d52bc3f2e95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:11.958453 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9d55120e-7915-4b7e-9d40-1d52bc3f2e95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:11.958938 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9d55120e-7915-4b7e-9d40-1d52bc3f2e95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:11.960058 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9d55120e-7915-4b7e-9d40-1d52bc3f2e95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:11.961112 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9d55120e-7915-4b7e-9d40-1d52bc3f2e95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:11.974570 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-257a30cc-cf83-40cd-bc56-e9fe9f1708ab tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:11.984723 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-257a30cc-cf83-40cd-bc56-e9fe9f1708ab tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.265143 Oct 28 12:13:11.987900 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 76/149] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:11 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:12.205870 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9d55120e-7915-4b7e-9d40-1d52bc3f2e95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:12.213633 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9d55120e-7915-4b7e-9d40-1d52bc3f2e95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:12.217705 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9d55120e-7915-4b7e-9d40-1d52bc3f2e95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:12.220426 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9d55120e-7915-4b7e-9d40-1d52bc3f2e95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1407 microversion: 2.20 time: 0.280300 Oct 28 12:13:12.221052 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 74/150] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:11 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:13:12.249308 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c26ea966-b4d0-4bcb-bc8c-0f70918847bc tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:12.250633 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c26ea966-b4d0-4bcb-bc8c-0f70918847bc tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:12.263762 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c26ea966-b4d0-4bcb-bc8c-0f70918847bc tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:12.264369 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c26ea966-b4d0-4bcb-bc8c-0f70918847bc tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:12.265441 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c26ea966-b4d0-4bcb-bc8c-0f70918847bc tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:12.265880 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c26ea966-b4d0-4bcb-bc8c-0f70918847bc tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:12.451680 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-5f139513-2e28-4111-9a45-4a2b3b76dd27 req-fa91eb8c-35c6-47b6-91ff-3e1516c31b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be58a22-3717-40ff-bd99-40e4eb31b6e8", "name": "network-vif-plugged", "status": "completed", "tag": "5e44939b-7777-4875-ae6d-f2d700df9c88"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:12.452143 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:13:12.452143 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:13:12.463071 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-5f139513-2e28-4111-9a45-4a2b3b76dd27 req-fa91eb8c-35c6-47b6-91ff-3e1516c31b45 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:12.463925 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-5f139513-2e28-4111-9a45-4a2b3b76dd27 req-fa91eb8c-35c6-47b6-91ff-3e1516c31b45 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:12.481047 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-5f139513-2e28-4111-9a45-4a2b3b76dd27 req-fa91eb8c-35c6-47b6-91ff-3e1516c31b45 service nova] Creating event network-vif-plugged:5e44939b-7777-4875-ae6d-f2d700df9c88 for instance 2be58a22-3717-40ff-bd99-40e4eb31b6e8 on hv-cinder-81571 Oct 28 12:13:12.486729 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-5f139513-2e28-4111-9a45-4a2b3b76dd27 req-fa91eb8c-35c6-47b6-91ff-3e1516c31b45 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127695 Oct 28 12:13:12.488532 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 75/151] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:13:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:13:12.496155 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c26ea966-b4d0-4bcb-bc8c-0f70918847bc tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:12.504809 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c26ea966-b4d0-4bcb-bc8c-0f70918847bc tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.259127 Oct 28 12:13:12.505931 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 77/152] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:12 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:12.609177 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-136b1424-4605-4499-8d68-8b7511df48fc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:12.609962 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-136b1424-4605-4499-8d68-8b7511df48fc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:12.622053 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-136b1424-4605-4499-8d68-8b7511df48fc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:12.623046 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-136b1424-4605-4499-8d68-8b7511df48fc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:12.624886 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-136b1424-4605-4499-8d68-8b7511df48fc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:12.626086 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-136b1424-4605-4499-8d68-8b7511df48fc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:12.849088 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-136b1424-4605-4499-8d68-8b7511df48fc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:12.859247 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-136b1424-4605-4499-8d68-8b7511df48fc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.254722 Oct 28 12:13:12.860023 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 76/153] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:12 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:13.003494 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-30749797-b956-4f87-bdaf-d8ba6b21ea79 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:13.004109 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-30749797-b956-4f87-bdaf-d8ba6b21ea79 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:13.010896 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-30749797-b956-4f87-bdaf-d8ba6b21ea79 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:13.011337 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-30749797-b956-4f87-bdaf-d8ba6b21ea79 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:13.012111 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-30749797-b956-4f87-bdaf-d8ba6b21ea79 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:13.012533 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-30749797-b956-4f87-bdaf-d8ba6b21ea79 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:13.172658 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-30749797-b956-4f87-bdaf-d8ba6b21ea79 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:13.180140 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-30749797-b956-4f87-bdaf-d8ba6b21ea79 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.180360 Oct 28 12:13:13.180702 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 78/154] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:12 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:13.247091 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-73ab355f-f315-4820-a63a-1d59f804c9e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:13.247091 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-73ab355f-f315-4820-a63a-1d59f804c9e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:13.253490 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-73ab355f-f315-4820-a63a-1d59f804c9e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:13.254183 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-73ab355f-f315-4820-a63a-1d59f804c9e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:13.255139 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-73ab355f-f315-4820-a63a-1d59f804c9e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:13.255694 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-73ab355f-f315-4820-a63a-1d59f804c9e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:13.407259 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-73ab355f-f315-4820-a63a-1d59f804c9e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:13.416708 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-73ab355f-f315-4820-a63a-1d59f804c9e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:13.418636 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-73ab355f-f315-4820-a63a-1d59f804c9e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:13.420097 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-73ab355f-f315-4820-a63a-1d59f804c9e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1407 microversion: 2.20 time: 0.185256 Oct 28 12:13:13.420674 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 77/155] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:13 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:13:13.522486 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0260374e-73f0-49ab-8b65-9b84b10f2a08 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:13.523850 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0260374e-73f0-49ab-8b65-9b84b10f2a08 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:13.529905 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0260374e-73f0-49ab-8b65-9b84b10f2a08 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:13.530597 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0260374e-73f0-49ab-8b65-9b84b10f2a08 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:13.531614 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0260374e-73f0-49ab-8b65-9b84b10f2a08 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:13.532136 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0260374e-73f0-49ab-8b65-9b84b10f2a08 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:13.684824 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0260374e-73f0-49ab-8b65-9b84b10f2a08 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:13.693960 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0260374e-73f0-49ab-8b65-9b84b10f2a08 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.175800 Oct 28 12:13:13.694896 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 79/156] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:13 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:13.884750 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4f2cc0c5-a959-44f7-8536-90cce4f81d05 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:13.885882 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4f2cc0c5-a959-44f7-8536-90cce4f81d05 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:13.895423 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f2cc0c5-a959-44f7-8536-90cce4f81d05 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:13.896126 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f2cc0c5-a959-44f7-8536-90cce4f81d05 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:13.897269 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f2cc0c5-a959-44f7-8536-90cce4f81d05 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:13.897893 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f2cc0c5-a959-44f7-8536-90cce4f81d05 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:14.041167 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4f2cc0c5-a959-44f7-8536-90cce4f81d05 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:14.049587 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4f2cc0c5-a959-44f7-8536-90cce4f81d05 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.176580 Oct 28 12:13:14.050165 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 78/157] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:13 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:14.196308 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fdc7461b-dfa7-4430-b1bf-65a003b04a3c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:14.196912 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fdc7461b-dfa7-4430-b1bf-65a003b04a3c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:14.202623 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fdc7461b-dfa7-4430-b1bf-65a003b04a3c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:14.203091 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fdc7461b-dfa7-4430-b1bf-65a003b04a3c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:14.203843 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fdc7461b-dfa7-4430-b1bf-65a003b04a3c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:14.204262 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fdc7461b-dfa7-4430-b1bf-65a003b04a3c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:14.326207 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fdc7461b-dfa7-4430-b1bf-65a003b04a3c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:14.333475 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fdc7461b-dfa7-4430-b1bf-65a003b04a3c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.140724 Oct 28 12:13:14.334039 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 80/158] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:14 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:14.442477 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3351d91f-6c91-4744-bcc3-6804449c921a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:14.443457 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3351d91f-6c91-4744-bcc3-6804449c921a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:14.467301 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3351d91f-6c91-4744-bcc3-6804449c921a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:14.468228 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3351d91f-6c91-4744-bcc3-6804449c921a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:14.469776 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3351d91f-6c91-4744-bcc3-6804449c921a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:14.470804 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3351d91f-6c91-4744-bcc3-6804449c921a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:14.568807 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-b7984982-5e2f-407b-9af4-e58d46d2695a req-b2da421e-8512-48f5-91c3-aa2d41d6b249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8e6f3a-3f05-49d7-b1d4-b714a4382010", "name": "network-vif-plugged", "status": "completed", "tag": "9150fd45-c84d-4736-a6a2-8247b4b15dda"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:14.572628 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:13:14.572628 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:13:14.600918 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-b7984982-5e2f-407b-9af4-e58d46d2695a req-b2da421e-8512-48f5-91c3-aa2d41d6b249 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:14.602107 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-b7984982-5e2f-407b-9af4-e58d46d2695a req-b2da421e-8512-48f5-91c3-aa2d41d6b249 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:14.634998 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-b7984982-5e2f-407b-9af4-e58d46d2695a req-b2da421e-8512-48f5-91c3-aa2d41d6b249 service nova] Creating event network-vif-plugged:9150fd45-c84d-4736-a6a2-8247b4b15dda for instance 0e8e6f3a-3f05-49d7-b1d4-b714a4382010 on hv-cinder-81571 Oct 28 12:13:14.641651 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-b7984982-5e2f-407b-9af4-e58d46d2695a req-b2da421e-8512-48f5-91c3-aa2d41d6b249 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079148 Oct 28 12:13:14.643008 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 81/159] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:13:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:13:14.648725 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3351d91f-6c91-4744-bcc3-6804449c921a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:14.663759 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3351d91f-6c91-4744-bcc3-6804449c921a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:14.666878 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3351d91f-6c91-4744-bcc3-6804449c921a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:14.668794 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3351d91f-6c91-4744-bcc3-6804449c921a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1407 microversion: 2.20 time: 0.233129 Oct 28 12:13:14.684027 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 79/160] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:14 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:13:14.712178 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4e822fdc-9639-4b40-a6cc-8531489f1b18 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:14.712869 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4e822fdc-9639-4b40-a6cc-8531489f1b18 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:14.723461 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e822fdc-9639-4b40-a6cc-8531489f1b18 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:14.725939 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e822fdc-9639-4b40-a6cc-8531489f1b18 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:14.727506 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e822fdc-9639-4b40-a6cc-8531489f1b18 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:14.728426 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e822fdc-9639-4b40-a6cc-8531489f1b18 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:14.976887 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4e822fdc-9639-4b40-a6cc-8531489f1b18 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:14.984337 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4e822fdc-9639-4b40-a6cc-8531489f1b18 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1315 microversion: 2.1 time: 0.276270 Oct 28 12:13:14.990221 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 82/161] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:14 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:15.071777 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cce343a3-d37b-4813-9532-89e735b6448a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:15.072507 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cce343a3-d37b-4813-9532-89e735b6448a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:15.084027 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cce343a3-d37b-4813-9532-89e735b6448a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:15.084456 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cce343a3-d37b-4813-9532-89e735b6448a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:15.085279 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cce343a3-d37b-4813-9532-89e735b6448a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:15.085707 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cce343a3-d37b-4813-9532-89e735b6448a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:15.268214 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cce343a3-d37b-4813-9532-89e735b6448a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:15.276647 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cce343a3-d37b-4813-9532-89e735b6448a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.214999 Oct 28 12:13:15.277219 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 80/162] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:15 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:15.350183 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9780e9f4-2e97-4f11-9249-0690511e03d7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:15.350927 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9780e9f4-2e97-4f11-9249-0690511e03d7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:15.359774 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9780e9f4-2e97-4f11-9249-0690511e03d7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:15.360211 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9780e9f4-2e97-4f11-9249-0690511e03d7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:15.360969 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9780e9f4-2e97-4f11-9249-0690511e03d7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:15.361930 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9780e9f4-2e97-4f11-9249-0690511e03d7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:15.498443 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9780e9f4-2e97-4f11-9249-0690511e03d7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:15.507590 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9780e9f4-2e97-4f11-9249-0690511e03d7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.161939 Oct 28 12:13:15.513369 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 83/163] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:15 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:15.697747 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b13aa85b-ef31-45c4-a12a-cca3297b8d0d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:15.698382 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b13aa85b-ef31-45c4-a12a-cca3297b8d0d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:15.710176 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b13aa85b-ef31-45c4-a12a-cca3297b8d0d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:15.711846 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b13aa85b-ef31-45c4-a12a-cca3297b8d0d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:15.712964 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b13aa85b-ef31-45c4-a12a-cca3297b8d0d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:15.714372 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b13aa85b-ef31-45c4-a12a-cca3297b8d0d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:15.905902 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b13aa85b-ef31-45c4-a12a-cca3297b8d0d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:15.916538 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b13aa85b-ef31-45c4-a12a-cca3297b8d0d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:15.918618 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b13aa85b-ef31-45c4-a12a-cca3297b8d0d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:15.919781 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b13aa85b-ef31-45c4-a12a-cca3297b8d0d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1407 microversion: 2.20 time: 0.230178 Oct 28 12:13:15.932743 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 81/164] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:15 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:13:16.007622 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7e8834ae-728d-400b-a7cb-d7be785fe151 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:16.008338 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7e8834ae-728d-400b-a7cb-d7be785fe151 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:16.014809 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7e8834ae-728d-400b-a7cb-d7be785fe151 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:16.015255 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7e8834ae-728d-400b-a7cb-d7be785fe151 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:16.016082 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7e8834ae-728d-400b-a7cb-d7be785fe151 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:16.016519 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7e8834ae-728d-400b-a7cb-d7be785fe151 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:16.141288 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7e8834ae-728d-400b-a7cb-d7be785fe151 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:16.150486 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7e8834ae-728d-400b-a7cb-d7be785fe151 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1502 microversion: 2.1 time: 0.146294 Oct 28 12:13:16.151596 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 84/165] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:16 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1502 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:16.294600 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-34dcdbca-845c-4466-8e96-994ceccad7ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:16.295259 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-34dcdbca-845c-4466-8e96-994ceccad7ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:16.303548 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-34dcdbca-845c-4466-8e96-994ceccad7ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:16.304016 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-34dcdbca-845c-4466-8e96-994ceccad7ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:16.305041 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-34dcdbca-845c-4466-8e96-994ceccad7ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:16.305676 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-34dcdbca-845c-4466-8e96-994ceccad7ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:16.453614 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-34dcdbca-845c-4466-8e96-994ceccad7ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:16.464047 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-34dcdbca-845c-4466-8e96-994ceccad7ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.173627 Oct 28 12:13:16.477555 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 82/166] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:16 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:16.530158 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a7774c58-83e6-4303-9ddc-836a1b053234 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:16.530799 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a7774c58-83e6-4303-9ddc-836a1b053234 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:16.536753 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a7774c58-83e6-4303-9ddc-836a1b053234 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:16.537482 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a7774c58-83e6-4303-9ddc-836a1b053234 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:16.538405 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a7774c58-83e6-4303-9ddc-836a1b053234 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:16.539060 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a7774c58-83e6-4303-9ddc-836a1b053234 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:16.674741 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a7774c58-83e6-4303-9ddc-836a1b053234 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:16.682747 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a7774c58-83e6-4303-9ddc-836a1b053234 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1318 microversion: 2.1 time: 0.156286 Oct 28 12:13:16.683419 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 85/167] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:16 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:16.693822 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-deaf603a-b1f1-46cc-91f4-36fa57ad1d2c req-36f427c2-b43e-457b-8ce2-ae19d5c9bae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b1cf11-e525-409b-83da-1c26e1d9937d", "name": "network-vif-plugged", "status": "completed", "tag": "7fffbbcb-b6ac-4854-853b-b69ac56c5812"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:16.695423 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:13:16.695423 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:13:16.702148 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-deaf603a-b1f1-46cc-91f4-36fa57ad1d2c req-36f427c2-b43e-457b-8ce2-ae19d5c9bae6 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:16.702583 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-deaf603a-b1f1-46cc-91f4-36fa57ad1d2c req-36f427c2-b43e-457b-8ce2-ae19d5c9bae6 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:16.713481 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-deaf603a-b1f1-46cc-91f4-36fa57ad1d2c req-36f427c2-b43e-457b-8ce2-ae19d5c9bae6 service nova] Creating event network-vif-plugged:7fffbbcb-b6ac-4854-853b-b69ac56c5812 for instance 28b1cf11-e525-409b-83da-1c26e1d9937d on hv-cinder-81571 Oct 28 12:13:16.718378 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-deaf603a-b1f1-46cc-91f4-36fa57ad1d2c req-36f427c2-b43e-457b-8ce2-ae19d5c9bae6 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028884 Oct 28 12:13:16.719027 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 83/168] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:13:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:13:16.942176 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-305f96a8-eca6-47cb-9699-74494bbc964a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:16.943574 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-305f96a8-eca6-47cb-9699-74494bbc964a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:16.951803 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-305f96a8-eca6-47cb-9699-74494bbc964a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:16.952662 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-305f96a8-eca6-47cb-9699-74494bbc964a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:16.953609 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-305f96a8-eca6-47cb-9699-74494bbc964a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:16.954254 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-305f96a8-eca6-47cb-9699-74494bbc964a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:17.112007 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-305f96a8-eca6-47cb-9699-74494bbc964a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:17.120484 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-305f96a8-eca6-47cb-9699-74494bbc964a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:17.121985 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-305f96a8-eca6-47cb-9699-74494bbc964a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:17.123127 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-305f96a8-eca6-47cb-9699-74494bbc964a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1407 microversion: 2.20 time: 0.188148 Oct 28 12:13:17.123680 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 86/169] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:16 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:13:17.481335 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6ed69b58-07a4-40af-89fa-3046af7f3d2e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:17.482156 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6ed69b58-07a4-40af-89fa-3046af7f3d2e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:17.488435 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6ed69b58-07a4-40af-89fa-3046af7f3d2e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:17.488878 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6ed69b58-07a4-40af-89fa-3046af7f3d2e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:17.489670 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6ed69b58-07a4-40af-89fa-3046af7f3d2e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:17.490085 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6ed69b58-07a4-40af-89fa-3046af7f3d2e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:17.609969 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b4b6392f-7517-4d44-8aef-816fdd5a230c tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "834d03d2-eb61-453d-9f5f-a2d1294db738"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:17.622726 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b4b6392f-7517-4d44-8aef-816fdd5a230c tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:17.635946 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4b6392f-7517-4d44-8aef-816fdd5a230c tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:17.637267 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4b6392f-7517-4d44-8aef-816fdd5a230c tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:17.638335 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4b6392f-7517-4d44-8aef-816fdd5a230c tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:17.639005 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4b6392f-7517-4d44-8aef-816fdd5a230c tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:17.644695 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6ed69b58-07a4-40af-89fa-3046af7f3d2e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:17.653155 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6ed69b58-07a4-40af-89fa-3046af7f3d2e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.175615 Oct 28 12:13:17.667456 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 84/170] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:17 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:17.700614 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bc17679f-6586-438e-b079-20adb155a100 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:17.701220 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bc17679f-6586-438e-b079-20adb155a100 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:17.711228 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc17679f-6586-438e-b079-20adb155a100 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:17.711677 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc17679f-6586-438e-b079-20adb155a100 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:17.713121 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc17679f-6586-438e-b079-20adb155a100 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:17.713618 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc17679f-6586-438e-b079-20adb155a100 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:17.927240 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bc17679f-6586-438e-b079-20adb155a100 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:17.950400 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bc17679f-6586-438e-b079-20adb155a100 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1509 microversion: 2.1 time: 0.253640 Oct 28 12:13:17.964278 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 85/171] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:17 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:18.144938 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b4cbd276-da80-4fa4-bc8c-531170ea2a83 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:18.145616 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b4cbd276-da80-4fa4-bc8c-531170ea2a83 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:18.167994 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4cbd276-da80-4fa4-bc8c-531170ea2a83 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:18.168458 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4cbd276-da80-4fa4-bc8c-531170ea2a83 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:18.169224 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4cbd276-da80-4fa4-bc8c-531170ea2a83 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:18.169660 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b4cbd276-da80-4fa4-bc8c-531170ea2a83 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:18.204248 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b4b6392f-7517-4d44-8aef-816fdd5a230c tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "POST /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.601274 Oct 28 12:13:18.205710 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 87/172] 10.222.0.37 () {60 vars in 1322 bytes} [Thu Oct 28 12:13:17 2021] POST /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8/os-volume_attachments => generated 194 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:13:18.473229 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b4cbd276-da80-4fa4-bc8c-531170ea2a83 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:18.481954 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b4cbd276-da80-4fa4-bc8c-531170ea2a83 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:18.490186 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b4cbd276-da80-4fa4-bc8c-531170ea2a83 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:18.491381 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b4cbd276-da80-4fa4-bc8c-531170ea2a83 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1407 microversion: 2.20 time: 0.351721 Oct 28 12:13:18.491939 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 86/173] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:18 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:13:18.686794 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2a9edef4-6d40-4b15-953a-7691fcdda20a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:18.688314 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2a9edef4-6d40-4b15-953a-7691fcdda20a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:18.702773 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2a9edef4-6d40-4b15-953a-7691fcdda20a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:18.703214 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2a9edef4-6d40-4b15-953a-7691fcdda20a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:18.704017 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2a9edef4-6d40-4b15-953a-7691fcdda20a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:18.704437 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2a9edef4-6d40-4b15-953a-7691fcdda20a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:18.739417 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-0a7867f0-e4cf-49f1-85e3-5f0a3e55b2d2 req-e9fc881f-22ea-483b-925c-c5a6d64b5da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79ab524-bc96-45ce-91df-6713d6fcaaaf", "name": "network-vif-plugged", "status": "completed", "tag": "f783de9c-03e4-446f-b34b-e2edaa551d3c"}, {"server_uuid": "c85f2863-bf90-49f5-a7cb-a13e366f1a0d", "name": "network-vif-plugged", "status": "completed", "tag": "44584889-faf9-46d2-a381-15ee8d86d81a"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:18.741651 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:13:18.741651 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:13:18.758168 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-0a7867f0-e4cf-49f1-85e3-5f0a3e55b2d2 req-e9fc881f-22ea-483b-925c-c5a6d64b5da1 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:18.758959 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-0a7867f0-e4cf-49f1-85e3-5f0a3e55b2d2 req-e9fc881f-22ea-483b-925c-c5a6d64b5da1 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:18.792045 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-0a7867f0-e4cf-49f1-85e3-5f0a3e55b2d2 req-e9fc881f-22ea-483b-925c-c5a6d64b5da1 service nova] Creating event network-vif-plugged:f783de9c-03e4-446f-b34b-e2edaa551d3c for instance d79ab524-bc96-45ce-91df-6713d6fcaaaf on hv-cinder-81571 Oct 28 12:13:18.793543 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-0a7867f0-e4cf-49f1-85e3-5f0a3e55b2d2 req-e9fc881f-22ea-483b-925c-c5a6d64b5da1 service nova] Creating event network-vif-plugged:44584889-faf9-46d2-a381-15ee8d86d81a for instance c85f2863-bf90-49f5-a7cb-a13e366f1a0d on hv-cinder-81571 Oct 28 12:13:18.808202 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-0a7867f0-e4cf-49f1-85e3-5f0a3e55b2d2 req-e9fc881f-22ea-483b-925c-c5a6d64b5da1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077087 Oct 28 12:13:18.815471 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 87/174] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:13:18 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:13:19.027215 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2a9edef4-6d40-4b15-953a-7691fcdda20a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:19.039063 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2a9edef4-6d40-4b15-953a-7691fcdda20a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.358762 Oct 28 12:13:19.039890 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 88/175] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:18 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:19.509594 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-db586d17-321f-4249-b503-781b681afc05 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:19.511120 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-db586d17-321f-4249-b503-781b681afc05 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:19.518773 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db586d17-321f-4249-b503-781b681afc05 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:19.519317 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db586d17-321f-4249-b503-781b681afc05 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:19.520168 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db586d17-321f-4249-b503-781b681afc05 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:19.520806 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db586d17-321f-4249-b503-781b681afc05 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:19.656643 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-12278153-c822-4e60-a4bd-6b8080dbc107 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3dc57d1-1afe-4585-8ad6-3aa8e7c89dbd"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:19.658871 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-12278153-c822-4e60-a4bd-6b8080dbc107 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:19.678209 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-12278153-c822-4e60-a4bd-6b8080dbc107 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:19.678734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-12278153-c822-4e60-a4bd-6b8080dbc107 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:19.679505 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-12278153-c822-4e60-a4bd-6b8080dbc107 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:19.680074 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-12278153-c822-4e60-a4bd-6b8080dbc107 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:19.717427 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-db586d17-321f-4249-b503-781b681afc05 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:19.735234 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-db586d17-321f-4249-b503-781b681afc05 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:19.737393 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-db586d17-321f-4249-b503-781b681afc05 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:19.738529 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-db586d17-321f-4249-b503-781b681afc05 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1407 microversion: 2.20 time: 0.233262 Oct 28 12:13:19.741868 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 88/176] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:19 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:13:20.056663 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6d5dbde6-c4d4-4712-bcd0-01f31e726450 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:20.057493 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6d5dbde6-c4d4-4712-bcd0-01f31e726450 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:20.068626 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6d5dbde6-c4d4-4712-bcd0-01f31e726450 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:20.070037 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6d5dbde6-c4d4-4712-bcd0-01f31e726450 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:20.071969 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6d5dbde6-c4d4-4712-bcd0-01f31e726450 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:20.073347 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6d5dbde6-c4d4-4712-bcd0-01f31e726450 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:20.234361 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6d5dbde6-c4d4-4712-bcd0-01f31e726450 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:20.245427 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6d5dbde6-c4d4-4712-bcd0-01f31e726450 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.193077 Oct 28 12:13:20.246213 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 89/177] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:20 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:20.758608 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b21d36f3-5e75-4f96-a72f-d473f2ca86a5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:20.759240 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b21d36f3-5e75-4f96-a72f-d473f2ca86a5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:20.764951 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b21d36f3-5e75-4f96-a72f-d473f2ca86a5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:20.765621 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b21d36f3-5e75-4f96-a72f-d473f2ca86a5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:20.766118 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b21d36f3-5e75-4f96-a72f-d473f2ca86a5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:20.766536 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b21d36f3-5e75-4f96-a72f-d473f2ca86a5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:20.890815 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b21d36f3-5e75-4f96-a72f-d473f2ca86a5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:20.899447 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b21d36f3-5e75-4f96-a72f-d473f2ca86a5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:20.900971 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b21d36f3-5e75-4f96-a72f-d473f2ca86a5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:20.902137 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b21d36f3-5e75-4f96-a72f-d473f2ca86a5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1407 microversion: 2.20 time: 0.147213 Oct 28 12:13:20.902815 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 90/178] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:20 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:13:21.263201 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-097c5ca4-6856-4366-9140-8e12e88b3e48 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:21.263801 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-097c5ca4-6856-4366-9140-8e12e88b3e48 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:21.270654 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-097c5ca4-6856-4366-9140-8e12e88b3e48 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:21.271390 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-097c5ca4-6856-4366-9140-8e12e88b3e48 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:21.272171 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-097c5ca4-6856-4366-9140-8e12e88b3e48 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:21.272754 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-097c5ca4-6856-4366-9140-8e12e88b3e48 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:21.408783 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-097c5ca4-6856-4366-9140-8e12e88b3e48 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:21.416316 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-097c5ca4-6856-4366-9140-8e12e88b3e48 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.157486 Oct 28 12:13:21.416880 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 91/179] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:21 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:21.928989 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1ab39ce4-6946-4659-b86e-a5bb844874c2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:21.928989 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1ab39ce4-6946-4659-b86e-a5bb844874c2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:21.933397 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1ab39ce4-6946-4659-b86e-a5bb844874c2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:21.933867 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1ab39ce4-6946-4659-b86e-a5bb844874c2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:21.934655 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1ab39ce4-6946-4659-b86e-a5bb844874c2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:21.935396 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1ab39ce4-6946-4659-b86e-a5bb844874c2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:22.073107 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1ab39ce4-6946-4659-b86e-a5bb844874c2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:22.081549 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1ab39ce4-6946-4659-b86e-a5bb844874c2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:22.083114 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1ab39ce4-6946-4659-b86e-a5bb844874c2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:22.084200 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1ab39ce4-6946-4659-b86e-a5bb844874c2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1407 microversion: 2.20 time: 0.167496 Oct 28 12:13:22.084753 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 92/180] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:21 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:13:22.433582 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-78107b14-d27b-429e-98f9-49d77ee3ee48 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:22.434183 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-78107b14-d27b-429e-98f9-49d77ee3ee48 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:22.441283 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-78107b14-d27b-429e-98f9-49d77ee3ee48 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:22.441814 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-78107b14-d27b-429e-98f9-49d77ee3ee48 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:22.442666 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-78107b14-d27b-429e-98f9-49d77ee3ee48 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:22.443210 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-78107b14-d27b-429e-98f9-49d77ee3ee48 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:22.566972 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-78107b14-d27b-429e-98f9-49d77ee3ee48 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:22.574085 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-78107b14-d27b-429e-98f9-49d77ee3ee48 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.144171 Oct 28 12:13:22.574643 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 93/181] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:22 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:23.104709 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cab72796-5695-467d-b39b-25233f5ee877 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:23.105334 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cab72796-5695-467d-b39b-25233f5ee877 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:23.110976 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cab72796-5695-467d-b39b-25233f5ee877 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:23.111429 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cab72796-5695-467d-b39b-25233f5ee877 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:23.112168 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cab72796-5695-467d-b39b-25233f5ee877 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:23.112589 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cab72796-5695-467d-b39b-25233f5ee877 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:23.230783 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cab72796-5695-467d-b39b-25233f5ee877 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:23.238947 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cab72796-5695-467d-b39b-25233f5ee877 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:23.240423 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cab72796-5695-467d-b39b-25233f5ee877 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:23.241498 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cab72796-5695-467d-b39b-25233f5ee877 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1407 microversion: 2.20 time: 0.141542 Oct 28 12:13:23.242043 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 94/182] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:23 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:13:23.591139 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f01ce9e2-fff3-48ca-a561-64d664f22527 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:23.591736 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f01ce9e2-fff3-48ca-a561-64d664f22527 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:23.598129 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f01ce9e2-fff3-48ca-a561-64d664f22527 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:23.598562 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f01ce9e2-fff3-48ca-a561-64d664f22527 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:23.599333 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f01ce9e2-fff3-48ca-a561-64d664f22527 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:23.599768 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f01ce9e2-fff3-48ca-a561-64d664f22527 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:23.725813 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f01ce9e2-fff3-48ca-a561-64d664f22527 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:23.732882 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f01ce9e2-fff3-48ca-a561-64d664f22527 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.145311 Oct 28 12:13:23.733439 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 95/183] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:23 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:23.941188 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-12278153-c822-4e60-a4bd-6b8080dbc107 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "POST /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.289469 Oct 28 12:13:23.941880 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 89/184] 10.222.0.37 () {60 vars in 1322 bytes} [Thu Oct 28 12:13:19 2021] POST /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments => generated 194 bytes in 4292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:13:24.259124 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-24c1f2f1-225e-45ca-bda0-5e7a715ece50 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:24.259726 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-24c1f2f1-225e-45ca-bda0-5e7a715ece50 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:24.265471 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-24c1f2f1-225e-45ca-bda0-5e7a715ece50 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:24.265917 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-24c1f2f1-225e-45ca-bda0-5e7a715ece50 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:24.266712 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-24c1f2f1-225e-45ca-bda0-5e7a715ece50 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:24.267143 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-24c1f2f1-225e-45ca-bda0-5e7a715ece50 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:24.397460 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-24c1f2f1-225e-45ca-bda0-5e7a715ece50 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:24.405171 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-24c1f2f1-225e-45ca-bda0-5e7a715ece50 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:24.407662 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-24c1f2f1-225e-45ca-bda0-5e7a715ece50 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:24.409522 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-24c1f2f1-225e-45ca-bda0-5e7a715ece50 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1407 microversion: 2.20 time: 0.154118 Oct 28 12:13:24.410062 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 96/185] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:24 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:13:24.750489 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c1f930fa-f9cd-4549-9df8-f9420379f240 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:24.751103 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c1f930fa-f9cd-4549-9df8-f9420379f240 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:24.760437 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c1f930fa-f9cd-4549-9df8-f9420379f240 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:24.760873 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c1f930fa-f9cd-4549-9df8-f9420379f240 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:24.761620 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c1f930fa-f9cd-4549-9df8-f9420379f240 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:24.762041 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c1f930fa-f9cd-4549-9df8-f9420379f240 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:24.885655 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c1f930fa-f9cd-4549-9df8-f9420379f240 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:24.893221 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c1f930fa-f9cd-4549-9df8-f9420379f240 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.147233 Oct 28 12:13:24.893803 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 90/186] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:24 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:25.428162 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-574a4fc8-e566-450d-8688-99c993deda5f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:25.428824 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-574a4fc8-e566-450d-8688-99c993deda5f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:25.434812 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-574a4fc8-e566-450d-8688-99c993deda5f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:25.435263 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-574a4fc8-e566-450d-8688-99c993deda5f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:25.436039 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-574a4fc8-e566-450d-8688-99c993deda5f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:25.436468 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-574a4fc8-e566-450d-8688-99c993deda5f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:25.559041 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-574a4fc8-e566-450d-8688-99c993deda5f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:25.567243 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-574a4fc8-e566-450d-8688-99c993deda5f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:25.568720 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-574a4fc8-e566-450d-8688-99c993deda5f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:25.569886 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-574a4fc8-e566-450d-8688-99c993deda5f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1598 microversion: 2.20 time: 0.146150 Oct 28 12:13:25.570440 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 97/187] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:13:25 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1598 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:13:25.588121 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c8b738af-f1f4-4f64-8826-35faa5ec3037 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:25.588613 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c8b738af-f1f4-4f64-8826-35faa5ec3037 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:25.594728 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c8b738af-f1f4-4f64-8826-35faa5ec3037 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:25.595171 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c8b738af-f1f4-4f64-8826-35faa5ec3037 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:25.595931 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c8b738af-f1f4-4f64-8826-35faa5ec3037 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:25.596359 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c8b738af-f1f4-4f64-8826-35faa5ec3037 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:25.683654 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c8b738af-f1f4-4f64-8826-35faa5ec3037 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098890 Oct 28 12:13:25.684259 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 91/188] 10.222.0.37 () {60 vars in 1315 bytes} [Thu Oct 28 12:13:25 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:13:25.909224 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f1b39110-55a4-46ab-a08a-39b55f17dfe9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:25.909829 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f1b39110-55a4-46ab-a08a-39b55f17dfe9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:25.918357 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f1b39110-55a4-46ab-a08a-39b55f17dfe9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:25.918357 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f1b39110-55a4-46ab-a08a-39b55f17dfe9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:25.918357 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f1b39110-55a4-46ab-a08a-39b55f17dfe9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:25.918357 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f1b39110-55a4-46ab-a08a-39b55f17dfe9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:26.241510 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f1b39110-55a4-46ab-a08a-39b55f17dfe9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:26.248794 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f1b39110-55a4-46ab-a08a-39b55f17dfe9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.343230 Oct 28 12:13:26.249373 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 98/189] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:25 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:27.091353 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4f79a3ca-5f3a-48a2-9066-420042401b16 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:27.092326 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4f79a3ca-5f3a-48a2-9066-420042401b16 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:27.093568 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-09eded1e-3964-4226-9ad6-8336761d9f36 req-8263484f-cf37-40c8-a6b0-15c51eb877af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d79ab524-bc96-45ce-91df-6713d6fcaaaf", "tag": "f783de9c-03e4-446f-b34b-e2edaa551d3c"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:27.095340 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:13:27.095340 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:13:27.109493 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4f79a3ca-5f3a-48a2-9066-420042401b16 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:27.110372 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4f79a3ca-5f3a-48a2-9066-420042401b16 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:27.111416 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-09eded1e-3964-4226-9ad6-8336761d9f36 req-8263484f-cf37-40c8-a6b0-15c51eb877af service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:27.112512 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4f79a3ca-5f3a-48a2-9066-420042401b16 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:27.113122 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-09eded1e-3964-4226-9ad6-8336761d9f36 req-8263484f-cf37-40c8-a6b0-15c51eb877af service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:27.113841 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4f79a3ca-5f3a-48a2-9066-420042401b16 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:27.136022 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-09eded1e-3964-4226-9ad6-8336761d9f36 req-8263484f-cf37-40c8-a6b0-15c51eb877af service nova] Creating event network-changed:f783de9c-03e4-446f-b34b-e2edaa551d3c for instance d79ab524-bc96-45ce-91df-6713d6fcaaaf on hv-cinder-81571 Oct 28 12:13:27.144219 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-09eded1e-3964-4226-9ad6-8336761d9f36 req-8263484f-cf37-40c8-a6b0-15c51eb877af service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063329 Oct 28 12:13:27.154247 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 99/190] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:13:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:13:27.265692 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2ff1c758-e89b-4c1e-b3ae-cf0283e34da7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:27.266368 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2ff1c758-e89b-4c1e-b3ae-cf0283e34da7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:27.274067 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ff1c758-e89b-4c1e-b3ae-cf0283e34da7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:27.274503 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ff1c758-e89b-4c1e-b3ae-cf0283e34da7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:27.275286 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ff1c758-e89b-4c1e-b3ae-cf0283e34da7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:27.275709 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ff1c758-e89b-4c1e-b3ae-cf0283e34da7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:27.401789 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2ff1c758-e89b-4c1e-b3ae-cf0283e34da7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:27.409122 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2ff1c758-e89b-4c1e-b3ae-cf0283e34da7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.147366 Oct 28 12:13:27.409690 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 100/191] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:27 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:28.425408 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3a4d2109-693c-4473-ace0-750c21c577d3 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:28.426839 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3a4d2109-693c-4473-ace0-750c21c577d3 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:28.432621 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3a4d2109-693c-4473-ace0-750c21c577d3 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:28.433062 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3a4d2109-693c-4473-ace0-750c21c577d3 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:28.433811 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3a4d2109-693c-4473-ace0-750c21c577d3 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:28.434235 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3a4d2109-693c-4473-ace0-750c21c577d3 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:28.555974 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3a4d2109-693c-4473-ace0-750c21c577d3 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:28.563510 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3a4d2109-693c-4473-ace0-750c21c577d3 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.142041 Oct 28 12:13:28.564063 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 101/192] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:28 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:29.580365 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-29d0552c-0dc5-417e-839d-0aea7ff458da tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:29.581378 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-29d0552c-0dc5-417e-839d-0aea7ff458da tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:29.586897 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29d0552c-0dc5-417e-839d-0aea7ff458da tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:29.587333 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29d0552c-0dc5-417e-839d-0aea7ff458da tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:29.588089 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29d0552c-0dc5-417e-839d-0aea7ff458da tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:29.588508 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29d0552c-0dc5-417e-839d-0aea7ff458da tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:29.705021 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-29d0552c-0dc5-417e-839d-0aea7ff458da tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:29.712384 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-29d0552c-0dc5-417e-839d-0aea7ff458da tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.135739 Oct 28 12:13:29.712945 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 102/193] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:29 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:30.729173 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8bfb9c0c-e172-4558-8d06-9dc338973474 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:30.729831 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8bfb9c0c-e172-4558-8d06-9dc338973474 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:30.735692 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8bfb9c0c-e172-4558-8d06-9dc338973474 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:30.736136 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8bfb9c0c-e172-4558-8d06-9dc338973474 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:30.736954 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8bfb9c0c-e172-4558-8d06-9dc338973474 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:30.737406 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8bfb9c0c-e172-4558-8d06-9dc338973474 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:30.861048 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8bfb9c0c-e172-4558-8d06-9dc338973474 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:30.868137 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8bfb9c0c-e172-4558-8d06-9dc338973474 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.142587 Oct 28 12:13:30.868698 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 103/194] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:30 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:31.884746 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5644dc42-ef70-49ab-ba46-143245e03b44 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:31.885467 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5644dc42-ef70-49ab-ba46-143245e03b44 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:31.891490 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5644dc42-ef70-49ab-ba46-143245e03b44 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:31.891924 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5644dc42-ef70-49ab-ba46-143245e03b44 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:31.892676 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5644dc42-ef70-49ab-ba46-143245e03b44 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:31.893093 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5644dc42-ef70-49ab-ba46-143245e03b44 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:32.011653 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5644dc42-ef70-49ab-ba46-143245e03b44 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:32.018820 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5644dc42-ef70-49ab-ba46-143245e03b44 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.137724 Oct 28 12:13:32.019378 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 104/195] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:31 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:33.035326 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1793d3d8-72a6-426c-ab90-b9c1303a9368 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:33.035949 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1793d3d8-72a6-426c-ab90-b9c1303a9368 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:33.041694 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1793d3d8-72a6-426c-ab90-b9c1303a9368 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:33.042136 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1793d3d8-72a6-426c-ab90-b9c1303a9368 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:33.042923 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1793d3d8-72a6-426c-ab90-b9c1303a9368 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:33.043354 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1793d3d8-72a6-426c-ab90-b9c1303a9368 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:33.168363 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1793d3d8-72a6-426c-ab90-b9c1303a9368 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:33.175923 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1793d3d8-72a6-426c-ab90-b9c1303a9368 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.144216 Oct 28 12:13:33.177000 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 105/196] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:33 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:34.195821 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-137fb3ce-ac80-4b13-a564-8b9b6b24c938 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:34.196526 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-137fb3ce-ac80-4b13-a564-8b9b6b24c938 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:34.202180 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-137fb3ce-ac80-4b13-a564-8b9b6b24c938 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:34.202620 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-137fb3ce-ac80-4b13-a564-8b9b6b24c938 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:34.203398 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-137fb3ce-ac80-4b13-a564-8b9b6b24c938 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:34.203820 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-137fb3ce-ac80-4b13-a564-8b9b6b24c938 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:34.328766 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-137fb3ce-ac80-4b13-a564-8b9b6b24c938 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:34.336601 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-137fb3ce-ac80-4b13-a564-8b9b6b24c938 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.144938 Oct 28 12:13:34.337163 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 106/197] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:34 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:35.328847 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4f79a3ca-5f3a-48a2-9066-420042401b16 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 14 microversion: 2.20 time: 8.251783 Oct 28 12:13:35.332370 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 92/198] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:13:27 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 14 bytes in 8253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:35.363643 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7134d6e4-ea6c-4bd8-9a91-0c662b1f916b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:35.363643 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7134d6e4-ea6c-4bd8-9a91-0c662b1f916b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:35.365636 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7134d6e4-ea6c-4bd8-9a91-0c662b1f916b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:35.367607 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7134d6e4-ea6c-4bd8-9a91-0c662b1f916b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:35.368012 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7134d6e4-ea6c-4bd8-9a91-0c662b1f916b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:35.369080 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7134d6e4-ea6c-4bd8-9a91-0c662b1f916b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:35.535773 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7134d6e4-ea6c-4bd8-9a91-0c662b1f916b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:35.543773 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7134d6e4-ea6c-4bd8-9a91-0c662b1f916b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1322 microversion: 2.1 time: 0.192677 Oct 28 12:13:35.544336 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 107/199] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:35 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:36.340834 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-054236a0-367b-4518-991e-bcf11ca1fadc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:36.341855 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-054236a0-367b-4518-991e-bcf11ca1fadc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:36.350275 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-054236a0-367b-4518-991e-bcf11ca1fadc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:36.350746 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-054236a0-367b-4518-991e-bcf11ca1fadc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:36.351515 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-054236a0-367b-4518-991e-bcf11ca1fadc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:36.352238 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-054236a0-367b-4518-991e-bcf11ca1fadc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:36.435818 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-054236a0-367b-4518-991e-bcf11ca1fadc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 14 microversion: 2.20 time: 0.098958 Oct 28 12:13:36.436441 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 93/200] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:13:36 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:36.561657 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-123284b4-5342-4b9f-98ec-37ba34a4fdee tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:36.562505 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-123284b4-5342-4b9f-98ec-37ba34a4fdee tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:36.568573 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-123284b4-5342-4b9f-98ec-37ba34a4fdee tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:36.569067 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-123284b4-5342-4b9f-98ec-37ba34a4fdee tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:36.569844 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-123284b4-5342-4b9f-98ec-37ba34a4fdee tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:36.570271 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-123284b4-5342-4b9f-98ec-37ba34a4fdee tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:36.692186 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-123284b4-5342-4b9f-98ec-37ba34a4fdee tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:36.699709 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-123284b4-5342-4b9f-98ec-37ba34a4fdee tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1516 microversion: 2.1 time: 0.142416 Oct 28 12:13:36.700268 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 108/201] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:36 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1516 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:36.717789 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f0d653e5-b961-4144-bf13-c34083d91242 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:36.718819 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f0d653e5-b961-4144-bf13-c34083d91242 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:36.726316 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f0d653e5-b961-4144-bf13-c34083d91242 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:36.726787 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f0d653e5-b961-4144-bf13-c34083d91242 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:36.727648 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f0d653e5-b961-4144-bf13-c34083d91242 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:36.728068 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f0d653e5-b961-4144-bf13-c34083d91242 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:36.753738 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-f0d653e5-b961-4144-bf13-c34083d91242 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lazy-loading 'flavor' on Instance uuid c85f2863-bf90-49f5-a7cb-a13e366f1a0d {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:13:36.871832 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f0d653e5-b961-4144-bf13-c34083d91242 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "POST /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d/action" status: 200 len: 32 microversion: 2.1 time: 0.157884 Oct 28 12:13:36.873004 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 94/202] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:13:36 2021] POST /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:13:36.881454 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-26b9fa5a-76b4-4ebf-9bd2-b69a3cfaedfe tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:36.882056 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-26b9fa5a-76b4-4ebf-9bd2-b69a3cfaedfe tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:36.888329 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-26b9fa5a-76b4-4ebf-9bd2-b69a3cfaedfe tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:36.888768 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-26b9fa5a-76b4-4ebf-9bd2-b69a3cfaedfe tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:36.889742 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-26b9fa5a-76b4-4ebf-9bd2-b69a3cfaedfe tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:36.890333 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-26b9fa5a-76b4-4ebf-9bd2-b69a3cfaedfe tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:37.013143 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-26b9fa5a-76b4-4ebf-9bd2-b69a3cfaedfe tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:37.020302 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-26b9fa5a-76b4-4ebf-9bd2-b69a3cfaedfe tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.142506 Oct 28 12:13:37.021443 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 109/203] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:36 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:37.447125 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-aaa33037-8377-418b-9314-168cd3df1344 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:37.450193 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-aaa33037-8377-418b-9314-168cd3df1344 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:37.460844 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aaa33037-8377-418b-9314-168cd3df1344 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:37.461361 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aaa33037-8377-418b-9314-168cd3df1344 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:37.462194 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aaa33037-8377-418b-9314-168cd3df1344 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:37.462729 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aaa33037-8377-418b-9314-168cd3df1344 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:38.037315 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e7e19ce8-59a8-4c6a-a32e-3c504102c548 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:38.037911 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e7e19ce8-59a8-4c6a-a32e-3c504102c548 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:38.043785 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7e19ce8-59a8-4c6a-a32e-3c504102c548 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:38.044225 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7e19ce8-59a8-4c6a-a32e-3c504102c548 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:38.044973 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7e19ce8-59a8-4c6a-a32e-3c504102c548 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:38.045399 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7e19ce8-59a8-4c6a-a32e-3c504102c548 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:38.166703 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e7e19ce8-59a8-4c6a-a32e-3c504102c548 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:38.173970 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e7e19ce8-59a8-4c6a-a32e-3c504102c548 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.140728 Oct 28 12:13:38.174523 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 110/204] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:38 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:39.191094 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4ae3a96a-85e2-419f-aaab-1c813d0f5e90 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:39.191669 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4ae3a96a-85e2-419f-aaab-1c813d0f5e90 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:39.197412 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ae3a96a-85e2-419f-aaab-1c813d0f5e90 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:39.197844 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ae3a96a-85e2-419f-aaab-1c813d0f5e90 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:39.198601 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ae3a96a-85e2-419f-aaab-1c813d0f5e90 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:39.199053 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ae3a96a-85e2-419f-aaab-1c813d0f5e90 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:39.318502 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4ae3a96a-85e2-419f-aaab-1c813d0f5e90 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:39.325622 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4ae3a96a-85e2-419f-aaab-1c813d0f5e90 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.138124 Oct 28 12:13:39.326183 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 111/205] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:39 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:40.341727 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4e7627c5-4752-4b5e-94bc-65b80c7e801f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:40.342371 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4e7627c5-4752-4b5e-94bc-65b80c7e801f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:40.348056 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4e7627c5-4752-4b5e-94bc-65b80c7e801f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:40.348487 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4e7627c5-4752-4b5e-94bc-65b80c7e801f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:40.349403 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4e7627c5-4752-4b5e-94bc-65b80c7e801f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:40.349824 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4e7627c5-4752-4b5e-94bc-65b80c7e801f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:40.468328 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4e7627c5-4752-4b5e-94bc-65b80c7e801f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:40.475488 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4e7627c5-4752-4b5e-94bc-65b80c7e801f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.137444 Oct 28 12:13:40.476056 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 112/206] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:40 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:41.492421 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1fbd2179-d67b-4600-a1c8-40b5ad9448cb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:41.493090 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1fbd2179-d67b-4600-a1c8-40b5ad9448cb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:41.498846 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1fbd2179-d67b-4600-a1c8-40b5ad9448cb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:41.499291 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1fbd2179-d67b-4600-a1c8-40b5ad9448cb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:41.500049 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1fbd2179-d67b-4600-a1c8-40b5ad9448cb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:41.500481 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1fbd2179-d67b-4600-a1c8-40b5ad9448cb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:41.620324 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1fbd2179-d67b-4600-a1c8-40b5ad9448cb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:41.627573 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1fbd2179-d67b-4600-a1c8-40b5ad9448cb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.139290 Oct 28 12:13:41.628138 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 113/207] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:41 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:42.092546 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-aaa33037-8377-418b-9314-168cd3df1344 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 14 microversion: 2.20 time: 4.649758 Oct 28 12:13:42.093555 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 95/208] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:13:37 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 14 bytes in 4652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:42.643373 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6507cbdf-ba74-4ea9-82b0-42c816db06a9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:42.643963 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6507cbdf-ba74-4ea9-82b0-42c816db06a9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:42.649828 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6507cbdf-ba74-4ea9-82b0-42c816db06a9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:42.650261 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6507cbdf-ba74-4ea9-82b0-42c816db06a9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:42.651035 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6507cbdf-ba74-4ea9-82b0-42c816db06a9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:42.651456 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6507cbdf-ba74-4ea9-82b0-42c816db06a9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:42.772310 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6507cbdf-ba74-4ea9-82b0-42c816db06a9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:42.779423 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6507cbdf-ba74-4ea9-82b0-42c816db06a9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.139716 Oct 28 12:13:42.779972 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 114/209] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:42 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:43.103847 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-489b008c-12c5-42dd-85c3-0e7e667a83b5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:43.104836 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-489b008c-12c5-42dd-85c3-0e7e667a83b5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:43.112327 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-489b008c-12c5-42dd-85c3-0e7e667a83b5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:43.112777 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-489b008c-12c5-42dd-85c3-0e7e667a83b5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:43.113542 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-489b008c-12c5-42dd-85c3-0e7e667a83b5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:43.113977 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-489b008c-12c5-42dd-85c3-0e7e667a83b5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:43.192083 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-489b008c-12c5-42dd-85c3-0e7e667a83b5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 14 microversion: 2.20 time: 0.091913 Oct 28 12:13:43.193150 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 96/210] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:13:43 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:43.796555 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-92d76470-54f3-4566-8b10-8d1ce80f7ee1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:43.797163 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-92d76470-54f3-4566-8b10-8d1ce80f7ee1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:43.803185 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-92d76470-54f3-4566-8b10-8d1ce80f7ee1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:43.803624 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-92d76470-54f3-4566-8b10-8d1ce80f7ee1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:43.804461 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-92d76470-54f3-4566-8b10-8d1ce80f7ee1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:43.804892 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-92d76470-54f3-4566-8b10-8d1ce80f7ee1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:43.936385 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-92d76470-54f3-4566-8b10-8d1ce80f7ee1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:43.945408 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-92d76470-54f3-4566-8b10-8d1ce80f7ee1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.152587 Oct 28 12:13:43.945982 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 115/211] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:43 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:44.206901 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e7876b17-d210-465a-93ba-922db2d81ec6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:44.206901 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e7876b17-d210-465a-93ba-922db2d81ec6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:44.215484 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e7876b17-d210-465a-93ba-922db2d81ec6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:44.215922 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e7876b17-d210-465a-93ba-922db2d81ec6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:44.216728 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e7876b17-d210-465a-93ba-922db2d81ec6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:44.217155 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e7876b17-d210-465a-93ba-922db2d81ec6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:44.963227 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-722b6cb3-6e36-421f-9ed4-a8286e7018b2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:44.963818 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-722b6cb3-6e36-421f-9ed4-a8286e7018b2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:44.969707 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-722b6cb3-6e36-421f-9ed4-a8286e7018b2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:44.970149 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-722b6cb3-6e36-421f-9ed4-a8286e7018b2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:44.971023 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-722b6cb3-6e36-421f-9ed4-a8286e7018b2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:44.971384 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-722b6cb3-6e36-421f-9ed4-a8286e7018b2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:45.091017 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-722b6cb3-6e36-421f-9ed4-a8286e7018b2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:45.098805 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-722b6cb3-6e36-421f-9ed4-a8286e7018b2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.139389 Oct 28 12:13:45.107094 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 116/212] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:44 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:45.111762 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3f4b83ff-b48c-4bae-91e9-c652b845d1e9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:45.112281 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3f4b83ff-b48c-4bae-91e9-c652b845d1e9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:45.118662 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f4b83ff-b48c-4bae-91e9-c652b845d1e9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:45.119133 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f4b83ff-b48c-4bae-91e9-c652b845d1e9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:45.119920 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f4b83ff-b48c-4bae-91e9-c652b845d1e9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:45.120351 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f4b83ff-b48c-4bae-91e9-c652b845d1e9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:45.144061 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3f4b83ff-b48c-4bae-91e9-c652b845d1e9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:13:45.170527 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e7876b17-d210-465a-93ba-922db2d81ec6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 5173 microversion: 2.20 time: 0.970081 Oct 28 12:13:45.171236 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 97/213] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:13:44 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 5173 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:13:45.269579 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3f4b83ff-b48c-4bae-91e9-c652b845d1e9 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "DELETE /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 204 len: 0 microversion: 2.1 time: 0.161008 Oct 28 12:13:45.270285 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 117/214] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:13:45 2021] DELETE /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:13:45.279189 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b34c9ba0-4ac3-4f08-9bf4-25482d4b3367 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:45.279867 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b34c9ba0-4ac3-4f08-9bf4-25482d4b3367 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:45.286930 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b34c9ba0-4ac3-4f08-9bf4-25482d4b3367 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:45.287368 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b34c9ba0-4ac3-4f08-9bf4-25482d4b3367 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:45.288128 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b34c9ba0-4ac3-4f08-9bf4-25482d4b3367 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:45.288548 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b34c9ba0-4ac3-4f08-9bf4-25482d4b3367 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:45.414444 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b34c9ba0-4ac3-4f08-9bf4-25482d4b3367 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:45.422945 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b34c9ba0-4ac3-4f08-9bf4-25482d4b3367 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1554 microversion: 2.1 time: 0.148301 Oct 28 12:13:45.423528 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 98/215] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:45 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:46.115070 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3eee4c9a-e9bb-4907-8760-fc50b03c983c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:46.116313 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3eee4c9a-e9bb-4907-8760-fc50b03c983c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:46.122913 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3eee4c9a-e9bb-4907-8760-fc50b03c983c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:46.123353 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3eee4c9a-e9bb-4907-8760-fc50b03c983c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:46.124109 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3eee4c9a-e9bb-4907-8760-fc50b03c983c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:46.124530 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3eee4c9a-e9bb-4907-8760-fc50b03c983c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:46.181824 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f587b8bd-5c7d-4d9d-9874-910abb9ded95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:46.182729 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f587b8bd-5c7d-4d9d-9874-910abb9ded95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:46.189772 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f587b8bd-5c7d-4d9d-9874-910abb9ded95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:46.190212 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f587b8bd-5c7d-4d9d-9874-910abb9ded95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:46.191936 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f587b8bd-5c7d-4d9d-9874-910abb9ded95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:46.191936 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f587b8bd-5c7d-4d9d-9874-910abb9ded95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:46.250471 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3eee4c9a-e9bb-4907-8760-fc50b03c983c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:46.258492 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3eee4c9a-e9bb-4907-8760-fc50b03c983c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.147476 Oct 28 12:13:46.259092 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 118/216] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:46 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:46.440630 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-969ea189-bc6c-461a-8b54-6c572c2a816d tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:46.441250 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-969ea189-bc6c-461a-8b54-6c572c2a816d tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:46.447783 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-969ea189-bc6c-461a-8b54-6c572c2a816d tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:46.448219 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-969ea189-bc6c-461a-8b54-6c572c2a816d tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:46.448968 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-969ea189-bc6c-461a-8b54-6c572c2a816d tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:46.449390 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-969ea189-bc6c-461a-8b54-6c572c2a816d tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:46.568793 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-969ea189-bc6c-461a-8b54-6c572c2a816d tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:46.577083 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-969ea189-bc6c-461a-8b54-6c572c2a816d tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1554 microversion: 2.1 time: 0.140090 Oct 28 12:13:46.577659 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 119/217] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:46 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1554 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:47.275672 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5dd27052-d8ad-46d5-acfc-431d3c6f1862 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:47.276328 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5dd27052-d8ad-46d5-acfc-431d3c6f1862 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:47.282319 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5dd27052-d8ad-46d5-acfc-431d3c6f1862 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:47.282788 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5dd27052-d8ad-46d5-acfc-431d3c6f1862 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:47.283538 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5dd27052-d8ad-46d5-acfc-431d3c6f1862 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:47.283961 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5dd27052-d8ad-46d5-acfc-431d3c6f1862 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:47.411508 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5dd27052-d8ad-46d5-acfc-431d3c6f1862 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:47.419122 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5dd27052-d8ad-46d5-acfc-431d3c6f1862 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.147601 Oct 28 12:13:47.419688 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 120/218] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:47 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:47.595461 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ed84f0ad-d17f-42b7-ae9e-f4c08d32e195 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:47.596069 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ed84f0ad-d17f-42b7-ae9e-f4c08d32e195 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:47.602275 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed84f0ad-d17f-42b7-ae9e-f4c08d32e195 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:47.602741 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed84f0ad-d17f-42b7-ae9e-f4c08d32e195 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:47.603518 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed84f0ad-d17f-42b7-ae9e-f4c08d32e195 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:47.603946 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed84f0ad-d17f-42b7-ae9e-f4c08d32e195 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:47.725514 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ed84f0ad-d17f-42b7-ae9e-f4c08d32e195 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:47.733571 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ed84f0ad-d17f-42b7-ae9e-f4c08d32e195 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1554 microversion: 2.1 time: 0.142540 Oct 28 12:13:47.734137 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 121/219] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:47 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1554 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:48.435968 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9ca13972-2a0a-465b-bf8a-633b770b20a6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:48.436548 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9ca13972-2a0a-465b-bf8a-633b770b20a6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:48.442494 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9ca13972-2a0a-465b-bf8a-633b770b20a6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:48.443016 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9ca13972-2a0a-465b-bf8a-633b770b20a6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:48.444006 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9ca13972-2a0a-465b-bf8a-633b770b20a6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:48.445070 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9ca13972-2a0a-465b-bf8a-633b770b20a6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:48.563501 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9ca13972-2a0a-465b-bf8a-633b770b20a6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:48.571254 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9ca13972-2a0a-465b-bf8a-633b770b20a6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.138974 Oct 28 12:13:48.571792 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 122/220] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:48 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:48.750208 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-518f3183-54d8-4769-ba8f-6e6818b44d66 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:48.750854 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-518f3183-54d8-4769-ba8f-6e6818b44d66 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:48.756781 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-518f3183-54d8-4769-ba8f-6e6818b44d66 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:48.757221 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-518f3183-54d8-4769-ba8f-6e6818b44d66 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:48.757978 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-518f3183-54d8-4769-ba8f-6e6818b44d66 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:48.758398 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-518f3183-54d8-4769-ba8f-6e6818b44d66 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:48.874507 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-518f3183-54d8-4769-ba8f-6e6818b44d66 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:48.882161 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-518f3183-54d8-4769-ba8f-6e6818b44d66 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1554 microversion: 2.1 time: 0.135574 Oct 28 12:13:48.885393 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 123/221] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:48 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1554 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:49.587815 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c5b6d9eb-2735-498a-82d9-e47cb5daa248 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:49.588440 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c5b6d9eb-2735-498a-82d9-e47cb5daa248 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:49.594071 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c5b6d9eb-2735-498a-82d9-e47cb5daa248 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:49.594511 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c5b6d9eb-2735-498a-82d9-e47cb5daa248 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:49.595311 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c5b6d9eb-2735-498a-82d9-e47cb5daa248 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:49.595730 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c5b6d9eb-2735-498a-82d9-e47cb5daa248 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:49.722356 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c5b6d9eb-2735-498a-82d9-e47cb5daa248 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:49.730039 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c5b6d9eb-2735-498a-82d9-e47cb5daa248 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.146029 Oct 28 12:13:49.730607 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 124/222] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:49 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:49.900265 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-992e13da-82c0-4796-832b-032a776b0324 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:49.900902 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-992e13da-82c0-4796-832b-032a776b0324 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:49.906886 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-992e13da-82c0-4796-832b-032a776b0324 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:49.907337 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-992e13da-82c0-4796-832b-032a776b0324 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:49.908104 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-992e13da-82c0-4796-832b-032a776b0324 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:49.908532 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-992e13da-82c0-4796-832b-032a776b0324 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:50.028694 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-992e13da-82c0-4796-832b-032a776b0324 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:50.036875 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-992e13da-82c0-4796-832b-032a776b0324 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1554 microversion: 2.1 time: 0.140218 Oct 28 12:13:50.037421 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 125/223] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:49 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1554 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:50.746797 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4b24a2fd-abf0-4b56-b0b9-b3000b072575 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:50.747404 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4b24a2fd-abf0-4b56-b0b9-b3000b072575 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:50.753220 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4b24a2fd-abf0-4b56-b0b9-b3000b072575 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:50.753665 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4b24a2fd-abf0-4b56-b0b9-b3000b072575 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:50.754421 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4b24a2fd-abf0-4b56-b0b9-b3000b072575 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:50.754890 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4b24a2fd-abf0-4b56-b0b9-b3000b072575 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:50.879172 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4b24a2fd-abf0-4b56-b0b9-b3000b072575 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:50.886725 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4b24a2fd-abf0-4b56-b0b9-b3000b072575 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.143379 Oct 28 12:13:50.887401 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 126/224] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:50 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:51.052984 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-94769973-738f-441d-a66b-f84087f81ad7 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:51.053578 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-94769973-738f-441d-a66b-f84087f81ad7 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:51.059422 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94769973-738f-441d-a66b-f84087f81ad7 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:51.059868 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94769973-738f-441d-a66b-f84087f81ad7 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:51.060662 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94769973-738f-441d-a66b-f84087f81ad7 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:51.061090 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94769973-738f-441d-a66b-f84087f81ad7 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:51.179572 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-94769973-738f-441d-a66b-f84087f81ad7 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:51.190861 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-94769973-738f-441d-a66b-f84087f81ad7 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1554 microversion: 2.1 time: 0.140945 Oct 28 12:13:51.191563 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 127/225] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:51 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1554 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:51.904094 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-50267789-ec19-4a39-b5eb-24e16ca73b87 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:51.904714 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-50267789-ec19-4a39-b5eb-24e16ca73b87 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:51.910578 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50267789-ec19-4a39-b5eb-24e16ca73b87 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:51.911056 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50267789-ec19-4a39-b5eb-24e16ca73b87 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:51.911816 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50267789-ec19-4a39-b5eb-24e16ca73b87 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:51.912242 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50267789-ec19-4a39-b5eb-24e16ca73b87 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:52.035350 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-50267789-ec19-4a39-b5eb-24e16ca73b87 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:52.042965 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-50267789-ec19-4a39-b5eb-24e16ca73b87 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.143244 Oct 28 12:13:52.043524 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 128/226] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:51 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:52.212406 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fbaea2ea-ef18-46ca-a2b6-320ff836ec3b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:52.213000 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fbaea2ea-ef18-46ca-a2b6-320ff836ec3b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:52.218737 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fbaea2ea-ef18-46ca-a2b6-320ff836ec3b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:52.219178 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fbaea2ea-ef18-46ca-a2b6-320ff836ec3b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:52.219924 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fbaea2ea-ef18-46ca-a2b6-320ff836ec3b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:52.220345 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fbaea2ea-ef18-46ca-a2b6-320ff836ec3b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:52.336059 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fbaea2ea-ef18-46ca-a2b6-320ff836ec3b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:52.343624 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fbaea2ea-ef18-46ca-a2b6-320ff836ec3b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1554 microversion: 2.1 time: 0.135322 Oct 28 12:13:52.344191 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 129/227] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:52 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1554 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:52.571418 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f587b8bd-5c7d-4d9d-9874-910abb9ded95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 20434 microversion: 2.20 time: 6.389309 Oct 28 12:13:52.574748 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 99/228] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:13:46 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 20434 bytes in 6395 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:13:53.059601 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-469d85f4-7375-401a-985a-120bbfc0bf58 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:53.060194 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-469d85f4-7375-401a-985a-120bbfc0bf58 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:53.065813 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-469d85f4-7375-401a-985a-120bbfc0bf58 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:53.066248 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-469d85f4-7375-401a-985a-120bbfc0bf58 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:53.067037 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-469d85f4-7375-401a-985a-120bbfc0bf58 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:53.067463 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-469d85f4-7375-401a-985a-120bbfc0bf58 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:53.189891 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-469d85f4-7375-401a-985a-120bbfc0bf58 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:53.197763 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-469d85f4-7375-401a-985a-120bbfc0bf58 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.141713 Oct 28 12:13:53.198429 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 130/229] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:53 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:53.361521 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b84895f5-129e-437c-97ec-b09ffa1977ea tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:53.362211 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b84895f5-129e-437c-97ec-b09ffa1977ea tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:53.369596 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b84895f5-129e-437c-97ec-b09ffa1977ea tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:53.370045 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b84895f5-129e-437c-97ec-b09ffa1977ea tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:53.370843 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b84895f5-129e-437c-97ec-b09ffa1977ea tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:53.371276 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b84895f5-129e-437c-97ec-b09ffa1977ea tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:53.495268 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b84895f5-129e-437c-97ec-b09ffa1977ea tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:53.502893 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b84895f5-129e-437c-97ec-b09ffa1977ea tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1554 microversion: 2.1 time: 0.145395 Oct 28 12:13:53.503462 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 100/230] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:53 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1554 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:53.583554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c8b4b572-ac54-4bf5-8c40-40ee1f2cf00f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:53.585041 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c8b4b572-ac54-4bf5-8c40-40ee1f2cf00f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:53.590874 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8b4b572-ac54-4bf5-8c40-40ee1f2cf00f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:53.591320 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8b4b572-ac54-4bf5-8c40-40ee1f2cf00f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:53.592080 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8b4b572-ac54-4bf5-8c40-40ee1f2cf00f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:53.592507 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8b4b572-ac54-4bf5-8c40-40ee1f2cf00f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:53.713446 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c8b4b572-ac54-4bf5-8c40-40ee1f2cf00f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 21708 microversion: 2.20 time: 0.133288 Oct 28 12:13:53.714002 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 131/231] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:13:53 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 21708 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:13:54.219764 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4270a77b-8004-41f3-90b2-75c4e49a65e8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:54.220360 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4270a77b-8004-41f3-90b2-75c4e49a65e8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:54.227628 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4270a77b-8004-41f3-90b2-75c4e49a65e8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:54.228208 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4270a77b-8004-41f3-90b2-75c4e49a65e8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:54.229217 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4270a77b-8004-41f3-90b2-75c4e49a65e8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:54.229672 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4270a77b-8004-41f3-90b2-75c4e49a65e8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:54.357466 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4270a77b-8004-41f3-90b2-75c4e49a65e8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:54.364830 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4270a77b-8004-41f3-90b2-75c4e49a65e8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.148860 Oct 28 12:13:54.365902 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 101/232] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:54 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:54.520240 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2d3079dd-c7af-462d-aab8-d7185748dd70 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:54.520931 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2d3079dd-c7af-462d-aab8-d7185748dd70 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:54.527964 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2d3079dd-c7af-462d-aab8-d7185748dd70 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:54.528406 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2d3079dd-c7af-462d-aab8-d7185748dd70 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:54.529175 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2d3079dd-c7af-462d-aab8-d7185748dd70 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:54.529621 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2d3079dd-c7af-462d-aab8-d7185748dd70 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:54.659930 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2d3079dd-c7af-462d-aab8-d7185748dd70 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:54.668704 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2d3079dd-c7af-462d-aab8-d7185748dd70 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1554 microversion: 2.1 time: 0.152380 Oct 28 12:13:54.669302 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 132/233] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:54 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:54.724509 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-42c915de-1e53-402f-8554-0516e85df314 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:54.725829 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-42c915de-1e53-402f-8554-0516e85df314 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:54.732336 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-42c915de-1e53-402f-8554-0516e85df314 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:54.733087 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-42c915de-1e53-402f-8554-0516e85df314 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:54.733843 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-42c915de-1e53-402f-8554-0516e85df314 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:54.734303 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-42c915de-1e53-402f-8554-0516e85df314 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:54.828802 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-42c915de-1e53-402f-8554-0516e85df314 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 22854 microversion: 2.20 time: 0.107946 Oct 28 12:13:54.829491 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 102/234] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:13:54 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 22854 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:13:55.393233 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-544b265f-a041-4543-b159-a6e5bc99f26f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:55.394038 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-544b265f-a041-4543-b159-a6e5bc99f26f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:55.400622 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-544b265f-a041-4543-b159-a6e5bc99f26f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:55.401063 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-544b265f-a041-4543-b159-a6e5bc99f26f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:55.401832 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-544b265f-a041-4543-b159-a6e5bc99f26f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:55.402257 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-544b265f-a041-4543-b159-a6e5bc99f26f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:55.526880 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-544b265f-a041-4543-b159-a6e5bc99f26f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:55.534047 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-544b265f-a041-4543-b159-a6e5bc99f26f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.155459 Oct 28 12:13:55.534610 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 133/235] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:55 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:55.687079 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-66a2d1b2-734a-4a68-a37a-e7582beb6c3b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:55.687769 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-66a2d1b2-734a-4a68-a37a-e7582beb6c3b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:55.695165 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66a2d1b2-734a-4a68-a37a-e7582beb6c3b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:55.695613 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66a2d1b2-734a-4a68-a37a-e7582beb6c3b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:55.696387 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66a2d1b2-734a-4a68-a37a-e7582beb6c3b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:55.696812 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66a2d1b2-734a-4a68-a37a-e7582beb6c3b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:55.824071 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-66a2d1b2-734a-4a68-a37a-e7582beb6c3b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:55.832983 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-66a2d1b2-734a-4a68-a37a-e7582beb6c3b tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1554 microversion: 2.1 time: 0.149518 Oct 28 12:13:55.833569 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 103/236] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:55 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:13:55.841693 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0c44d05b-bf86-47d8-955c-7d05cfefc43e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:55.842999 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0c44d05b-bf86-47d8-955c-7d05cfefc43e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:55.849962 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0c44d05b-bf86-47d8-955c-7d05cfefc43e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:55.850573 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0c44d05b-bf86-47d8-955c-7d05cfefc43e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:55.851396 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0c44d05b-bf86-47d8-955c-7d05cfefc43e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:55.851823 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0c44d05b-bf86-47d8-955c-7d05cfefc43e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:55.946936 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0c44d05b-bf86-47d8-955c-7d05cfefc43e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 23803 microversion: 2.20 time: 0.109397 Oct 28 12:13:55.947602 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 134/237] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:13:55 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 23803 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:13:56.552515 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ed6e5fc8-8ca8-48f6-a15d-d0d1e933645f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:56.553026 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ed6e5fc8-8ca8-48f6-a15d-d0d1e933645f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:56.560283 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ed6e5fc8-8ca8-48f6-a15d-d0d1e933645f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:56.560714 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ed6e5fc8-8ca8-48f6-a15d-d0d1e933645f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:56.561483 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ed6e5fc8-8ca8-48f6-a15d-d0d1e933645f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:56.561910 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ed6e5fc8-8ca8-48f6-a15d-d0d1e933645f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:56.721914 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ed6e5fc8-8ca8-48f6-a15d-d0d1e933645f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:56.730519 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ed6e5fc8-8ca8-48f6-a15d-d0d1e933645f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.181742 Oct 28 12:13:56.739914 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 104/238] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:56 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:56.852287 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4d6fd266-8c7b-43b3-acf0-17cfc54a47ae tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:56.852919 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4d6fd266-8c7b-43b3-acf0-17cfc54a47ae tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:56.860276 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4d6fd266-8c7b-43b3-acf0-17cfc54a47ae tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:56.860577 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4d6fd266-8c7b-43b3-acf0-17cfc54a47ae tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:56.861359 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4d6fd266-8c7b-43b3-acf0-17cfc54a47ae tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:56.861868 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4d6fd266-8c7b-43b3-acf0-17cfc54a47ae tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:56.962806 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9bb9aaad-7862-46c6-b40b-6fc063019fcc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:56.963751 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9bb9aaad-7862-46c6-b40b-6fc063019fcc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:56.969967 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9bb9aaad-7862-46c6-b40b-6fc063019fcc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:56.970410 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9bb9aaad-7862-46c6-b40b-6fc063019fcc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:56.971203 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9bb9aaad-7862-46c6-b40b-6fc063019fcc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:56.971628 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9bb9aaad-7862-46c6-b40b-6fc063019fcc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:57.074876 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9bb9aaad-7862-46c6-b40b-6fc063019fcc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 24529 microversion: 2.20 time: 0.119806 Oct 28 12:13:57.075476 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 105/239] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:13:56 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 24529 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:13:57.330409 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4d6fd266-8c7b-43b3-acf0-17cfc54a47ae tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:57.338272 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4d6fd266-8c7b-43b3-acf0-17cfc54a47ae tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1554 microversion: 2.1 time: 0.491133 Oct 28 12:13:57.338871 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 135/240] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:56 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1554 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:57.535159 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-a4e25a46-2700-467d-9d39-d4e82e28f0fe req-fae041cb-46b2-4e88-82b1-ec63207c7dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be58a22-3717-40ff-bd99-40e4eb31b6e8", "name": "network-vif-deleted", "tag": "5e44939b-7777-4875-ae6d-f2d700df9c88"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:57.536856 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:13:57.536856 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:13:57.545591 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-a4e25a46-2700-467d-9d39-d4e82e28f0fe req-fae041cb-46b2-4e88-82b1-ec63207c7dae service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:57.546022 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-a4e25a46-2700-467d-9d39-d4e82e28f0fe req-fae041cb-46b2-4e88-82b1-ec63207c7dae service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:57.559093 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-a4e25a46-2700-467d-9d39-d4e82e28f0fe req-fae041cb-46b2-4e88-82b1-ec63207c7dae service nova] Creating event network-vif-deleted:5e44939b-7777-4875-ae6d-f2d700df9c88 for instance 2be58a22-3717-40ff-bd99-40e4eb31b6e8 on hv-cinder-81571 Oct 28 12:13:57.565765 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-a4e25a46-2700-467d-9d39-d4e82e28f0fe req-fae041cb-46b2-4e88-82b1-ec63207c7dae service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034554 Oct 28 12:13:57.567487 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 106/241] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:13:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:13:57.747403 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b656652d-e7cd-4078-bbb3-88cc2a7ad5fb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:57.748186 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b656652d-e7cd-4078-bbb3-88cc2a7ad5fb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:57.756438 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b656652d-e7cd-4078-bbb3-88cc2a7ad5fb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:57.756990 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b656652d-e7cd-4078-bbb3-88cc2a7ad5fb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:57.757965 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b656652d-e7cd-4078-bbb3-88cc2a7ad5fb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:57.758398 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b656652d-e7cd-4078-bbb3-88cc2a7ad5fb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:57.879876 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b656652d-e7cd-4078-bbb3-88cc2a7ad5fb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:57.891256 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b656652d-e7cd-4078-bbb3-88cc2a7ad5fb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.147670 Oct 28 12:13:57.891877 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 136/242] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:57 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:58.087486 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-808c9dcb-dd4a-4f2d-b8ce-7287b758c3ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:58.088434 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-808c9dcb-dd4a-4f2d-b8ce-7287b758c3ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:58.094421 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-808c9dcb-dd4a-4f2d-b8ce-7287b758c3ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:58.094898 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-808c9dcb-dd4a-4f2d-b8ce-7287b758c3ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:58.095661 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-808c9dcb-dd4a-4f2d-b8ce-7287b758c3ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:58.096084 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-808c9dcb-dd4a-4f2d-b8ce-7287b758c3ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:58.188245 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-808c9dcb-dd4a-4f2d-b8ce-7287b758c3ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 25190 microversion: 2.20 time: 0.105831 Oct 28 12:13:58.188896 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 107/243] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:13:58 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 25190 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:13:58.356074 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-dd3451f5-f8b7-4f68-9f57-9554e1a05ade tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:58.356702 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-dd3451f5-f8b7-4f68-9f57-9554e1a05ade tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:58.362954 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd3451f5-f8b7-4f68-9f57-9554e1a05ade tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:58.363391 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd3451f5-f8b7-4f68-9f57-9554e1a05ade tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:58.364148 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd3451f5-f8b7-4f68-9f57-9554e1a05ade tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:58.364631 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd3451f5-f8b7-4f68-9f57-9554e1a05ade tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:58.428796 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-dd3451f5-f8b7-4f68-9f57-9554e1a05ade tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:58.436675 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-dd3451f5-f8b7-4f68-9f57-9554e1a05ade tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1346 microversion: 2.1 time: 0.084209 Oct 28 12:13:58.437229 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 137/244] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:58 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:58.908359 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0b8d8bf2-44d4-4421-94e1-95048021bc36 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:58.909039 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0b8d8bf2-44d4-4421-94e1-95048021bc36 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:58.915833 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0b8d8bf2-44d4-4421-94e1-95048021bc36 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:58.916273 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0b8d8bf2-44d4-4421-94e1-95048021bc36 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:58.917027 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0b8d8bf2-44d4-4421-94e1-95048021bc36 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:58.917453 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0b8d8bf2-44d4-4421-94e1-95048021bc36 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:59.037157 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0b8d8bf2-44d4-4421-94e1-95048021bc36 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:59.045064 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0b8d8bf2-44d4-4421-94e1-95048021bc36 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.140717 Oct 28 12:13:59.045926 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 108/245] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:58 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:13:59.200912 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3be1e2de-3974-46f0-8cd9-25406334932e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:13:59.202026 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3be1e2de-3974-46f0-8cd9-25406334932e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:59.208358 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3be1e2de-3974-46f0-8cd9-25406334932e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:59.208801 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3be1e2de-3974-46f0-8cd9-25406334932e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:59.209559 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3be1e2de-3974-46f0-8cd9-25406334932e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:59.209988 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3be1e2de-3974-46f0-8cd9-25406334932e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:59.348548 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3be1e2de-3974-46f0-8cd9-25406334932e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 26009 microversion: 2.20 time: 0.151414 Oct 28 12:13:59.349183 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 138/246] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:13:59 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 26009 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:13:59.454210 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-769f2ab4-3e16-4b2b-992d-71c999472bdd tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:13:59.454857 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-769f2ab4-3e16-4b2b-992d-71c999472bdd tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:13:59.462096 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-769f2ab4-3e16-4b2b-992d-71c999472bdd tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:59.462634 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-769f2ab4-3e16-4b2b-992d-71c999472bdd tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:59.463539 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-769f2ab4-3e16-4b2b-992d-71c999472bdd tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:59.463978 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-769f2ab4-3e16-4b2b-992d-71c999472bdd tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:59.501398 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-769f2ab4-3e16-4b2b-992d-71c999472bdd tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:13:59.501832 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-769f2ab4-3e16-4b2b-992d-71c999472bdd tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:13:59.502265 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-769f2ab4-3e16-4b2b-992d-71c999472bdd tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lazy-loading 'fault' on Instance uuid 2be58a22-3717-40ff-bd99-40e4eb31b6e8 {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:13:59.549440 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-769f2ab4-3e16-4b2b-992d-71c999472bdd tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b74576b5fc34bd9b851e009a5de3f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac030a59d7441d958e8657b702b9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:13:59.556819 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-769f2ab4-3e16-4b2b-992d-71c999472bdd tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 200 len: 1305 microversion: 2.1 time: 0.106796 Oct 28 12:13:59.557396 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 109/247] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:13:59 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 1305 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:00.062497 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5ff38d4a-fe70-4111-b724-c48a67fd3ceb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:00.063212 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5ff38d4a-fe70-4111-b724-c48a67fd3ceb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:00.070355 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ff38d4a-fe70-4111-b724-c48a67fd3ceb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:00.070827 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ff38d4a-fe70-4111-b724-c48a67fd3ceb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:00.071579 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ff38d4a-fe70-4111-b724-c48a67fd3ceb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:00.072003 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ff38d4a-fe70-4111-b724-c48a67fd3ceb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:00.193962 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5ff38d4a-fe70-4111-b724-c48a67fd3ceb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:00.201643 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5ff38d4a-fe70-4111-b724-c48a67fd3ceb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.143056 Oct 28 12:14:00.202210 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 139/248] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:00 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:00.360624 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-660485de-a389-464d-a7c5-ea3b889b4a89 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:00.361568 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-660485de-a389-464d-a7c5-ea3b889b4a89 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:00.368244 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-660485de-a389-464d-a7c5-ea3b889b4a89 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:00.368687 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-660485de-a389-464d-a7c5-ea3b889b4a89 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:00.369448 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-660485de-a389-464d-a7c5-ea3b889b4a89 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:00.369878 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-660485de-a389-464d-a7c5-ea3b889b4a89 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:00.574125 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d14af87d-42f3-4487-9de3-7432314c168a tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:00.574747 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d14af87d-42f3-4487-9de3-7432314c168a tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:00.580876 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d14af87d-42f3-4487-9de3-7432314c168a tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:00.581320 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d14af87d-42f3-4487-9de3-7432314c168a tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:00.582079 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d14af87d-42f3-4487-9de3-7432314c168a tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:00.582507 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d14af87d-42f3-4487-9de3-7432314c168a tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:00.595161 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-d14af87d-42f3-4487-9de3-7432314c168a tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] HTTP exception thrown: Instance 2be58a22-3717-40ff-bd99-40e4eb31b6e8 could not be found. Oct 28 12:14:00.595733 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d14af87d-42f3-4487-9de3-7432314c168a tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Returning 404 to user: Instance 2be58a22-3717-40ff-bd99-40e4eb31b6e8 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:14:00.596559 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d14af87d-42f3-4487-9de3-7432314c168a tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 404 len: 111 microversion: 2.1 time: 0.026690 Oct 28 12:14:00.597063 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 140/249] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:00 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 12:14:00.692662 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-19669244-6e14-4c8c-bb12-32e52a27d608 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:00.693559 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-19669244-6e14-4c8c-bb12-32e52a27d608 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:00.700425 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-19669244-6e14-4c8c-bb12-32e52a27d608 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:00.700865 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-19669244-6e14-4c8c-bb12-32e52a27d608 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:00.701618 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-19669244-6e14-4c8c-bb12-32e52a27d608 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:00.702049 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-19669244-6e14-4c8c-bb12-32e52a27d608 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:00.714210 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-19669244-6e14-4c8c-bb12-32e52a27d608 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] HTTP exception thrown: Instance 2be58a22-3717-40ff-bd99-40e4eb31b6e8 could not be found. Oct 28 12:14:00.714803 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-19669244-6e14-4c8c-bb12-32e52a27d608 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Returning 404 to user: Instance 2be58a22-3717-40ff-bd99-40e4eb31b6e8 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:14:00.715598 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-19669244-6e14-4c8c-bb12-32e52a27d608 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.026671 Oct 28 12:14:00.716108 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 141/250] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:14:00 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8/os-volume_attachments => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 12:14:01.218499 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-dd78ea82-30be-41fc-b14a-13b3986c2b84 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:01.219121 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-dd78ea82-30be-41fc-b14a-13b3986c2b84 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:01.225184 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd78ea82-30be-41fc-b14a-13b3986c2b84 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:01.225624 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd78ea82-30be-41fc-b14a-13b3986c2b84 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:01.226373 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd78ea82-30be-41fc-b14a-13b3986c2b84 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:01.226833 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd78ea82-30be-41fc-b14a-13b3986c2b84 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:01.344922 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-dd78ea82-30be-41fc-b14a-13b3986c2b84 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:01.352103 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-dd78ea82-30be-41fc-b14a-13b3986c2b84 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.137129 Oct 28 12:14:01.352655 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 142/251] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:01 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:02.368326 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-962903d1-fe49-4b5b-b202-e72d62a39f80 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:02.369343 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-962903d1-fe49-4b5b-b202-e72d62a39f80 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:02.375656 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-962903d1-fe49-4b5b-b202-e72d62a39f80 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:02.376100 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-962903d1-fe49-4b5b-b202-e72d62a39f80 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:02.376863 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-962903d1-fe49-4b5b-b202-e72d62a39f80 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:02.377292 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-962903d1-fe49-4b5b-b202-e72d62a39f80 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:02.503409 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-962903d1-fe49-4b5b-b202-e72d62a39f80 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:02.511518 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-962903d1-fe49-4b5b-b202-e72d62a39f80 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.146796 Oct 28 12:14:02.512101 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 143/252] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:02 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:03.528503 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6c21f2cf-9f2f-4464-9e27-2ea814799583 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:03.529102 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6c21f2cf-9f2f-4464-9e27-2ea814799583 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:03.535430 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c21f2cf-9f2f-4464-9e27-2ea814799583 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:03.535895 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c21f2cf-9f2f-4464-9e27-2ea814799583 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:03.536661 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c21f2cf-9f2f-4464-9e27-2ea814799583 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:03.537092 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c21f2cf-9f2f-4464-9e27-2ea814799583 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:03.654651 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6c21f2cf-9f2f-4464-9e27-2ea814799583 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:03.661955 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6c21f2cf-9f2f-4464-9e27-2ea814799583 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.137122 Oct 28 12:14:03.662533 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 144/253] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:03 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:04.679962 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-12134ff7-599c-4ac2-8b68-36c799657d4b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:04.680694 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-12134ff7-599c-4ac2-8b68-36c799657d4b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:04.687087 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-12134ff7-599c-4ac2-8b68-36c799657d4b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:04.687532 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-12134ff7-599c-4ac2-8b68-36c799657d4b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:04.688301 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-12134ff7-599c-4ac2-8b68-36c799657d4b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:04.688735 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-12134ff7-599c-4ac2-8b68-36c799657d4b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:04.803574 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-12134ff7-599c-4ac2-8b68-36c799657d4b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:04.811397 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-12134ff7-599c-4ac2-8b68-36c799657d4b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.135691 Oct 28 12:14:04.811975 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 145/254] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:04 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:04.998339 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-660485de-a389-464d-a7c5-ea3b889b4a89 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 27763 microversion: 2.20 time: 4.641181 Oct 28 12:14:04.998925 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 110/255] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:00 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 27763 bytes in 4643 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:14:05.828031 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0d64a98e-8566-4497-a847-4aa6682ffbe0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:05.828875 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0d64a98e-8566-4497-a847-4aa6682ffbe0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:05.837245 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0d64a98e-8566-4497-a847-4aa6682ffbe0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:05.837683 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0d64a98e-8566-4497-a847-4aa6682ffbe0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:05.838448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0d64a98e-8566-4497-a847-4aa6682ffbe0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:05.838940 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0d64a98e-8566-4497-a847-4aa6682ffbe0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:05.962308 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0d64a98e-8566-4497-a847-4aa6682ffbe0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:05.969492 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0d64a98e-8566-4497-a847-4aa6682ffbe0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.145208 Oct 28 12:14:05.970054 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 146/256] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:05 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:06.010094 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b876ede2-b732-46cd-8f55-760b717f4d78 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:06.011048 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b876ede2-b732-46cd-8f55-760b717f4d78 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:06.017929 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b876ede2-b732-46cd-8f55-760b717f4d78 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:06.018364 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b876ede2-b732-46cd-8f55-760b717f4d78 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:06.019139 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b876ede2-b732-46cd-8f55-760b717f4d78 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:06.019564 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b876ede2-b732-46cd-8f55-760b717f4d78 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:06.986358 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4f48c9d6-76bb-4868-8a4e-4aa5c971d082 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:06.986967 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4f48c9d6-76bb-4868-8a4e-4aa5c971d082 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:06.993081 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f48c9d6-76bb-4868-8a4e-4aa5c971d082 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:06.993512 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f48c9d6-76bb-4868-8a4e-4aa5c971d082 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:06.994255 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f48c9d6-76bb-4868-8a4e-4aa5c971d082 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:06.994673 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f48c9d6-76bb-4868-8a4e-4aa5c971d082 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:07.113484 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4f48c9d6-76bb-4868-8a4e-4aa5c971d082 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:07.120778 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4f48c9d6-76bb-4868-8a4e-4aa5c971d082 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.138000 Oct 28 12:14:07.121343 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 147/257] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:06 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:08.137697 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0d7917a4-d89d-4b89-925f-399a74acd3d2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:08.138325 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0d7917a4-d89d-4b89-925f-399a74acd3d2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:08.144440 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0d7917a4-d89d-4b89-925f-399a74acd3d2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:08.144870 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0d7917a4-d89d-4b89-925f-399a74acd3d2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:08.145618 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0d7917a4-d89d-4b89-925f-399a74acd3d2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:08.146037 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0d7917a4-d89d-4b89-925f-399a74acd3d2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:08.265979 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0d7917a4-d89d-4b89-925f-399a74acd3d2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:08.274642 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0d7917a4-d89d-4b89-925f-399a74acd3d2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.140522 Oct 28 12:14:08.275224 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 148/258] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:08 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:09.290223 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-178d8fcc-21fd-437b-a96d-c273780a3087 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:09.290912 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-178d8fcc-21fd-437b-a96d-c273780a3087 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:09.297597 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-178d8fcc-21fd-437b-a96d-c273780a3087 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:09.298119 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-178d8fcc-21fd-437b-a96d-c273780a3087 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:09.299156 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-178d8fcc-21fd-437b-a96d-c273780a3087 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:09.299592 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-178d8fcc-21fd-437b-a96d-c273780a3087 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:09.426359 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-178d8fcc-21fd-437b-a96d-c273780a3087 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:09.434073 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-178d8fcc-21fd-437b-a96d-c273780a3087 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.147640 Oct 28 12:14:09.434640 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 149/259] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:09 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:10.450554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-31694dd4-2a95-4ca6-ab0d-a808a1f4f60c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:10.451228 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-31694dd4-2a95-4ca6-ab0d-a808a1f4f60c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:10.457531 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-31694dd4-2a95-4ca6-ab0d-a808a1f4f60c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:10.457973 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-31694dd4-2a95-4ca6-ab0d-a808a1f4f60c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:10.458767 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-31694dd4-2a95-4ca6-ab0d-a808a1f4f60c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:10.459196 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-31694dd4-2a95-4ca6-ab0d-a808a1f4f60c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:10.582227 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-31694dd4-2a95-4ca6-ab0d-a808a1f4f60c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:10.589438 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-31694dd4-2a95-4ca6-ab0d-a808a1f4f60c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.142499 Oct 28 12:14:10.589990 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 150/260] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:10 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:10.828964 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b876ede2-b732-46cd-8f55-760b717f4d78 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 27828 microversion: 2.20 time: 4.822714 Oct 28 12:14:10.829786 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 111/261] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:06 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 27828 bytes in 4825 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:14:11.585484 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-30f0270a-89dc-42d5-b729-249daf0bdbfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1444554550", "imageRef": "4385a199-a3e9-4c11-b580-60e7a24d0e97", "flavorRef": "452", "networks": [{"uuid": "6473d7e8-f419-4ba9-aecd-de2094cc6dd8"}]}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:11.608203 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c50170ad-2de3-4e45-9566-8e0839bc7c42 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:11.610061 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c50170ad-2de3-4e45-9566-8e0839bc7c42 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:11.617303 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c50170ad-2de3-4e45-9566-8e0839bc7c42 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:11.617693 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c50170ad-2de3-4e45-9566-8e0839bc7c42 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:11.618477 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c50170ad-2de3-4e45-9566-8e0839bc7c42 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:11.618929 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c50170ad-2de3-4e45-9566-8e0839bc7c42 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:11.637621 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-30f0270a-89dc-42d5-b729-249daf0bdbfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] validate_networks() for [('6473d7e8-f419-4ba9-aecd-de2094cc6dd8', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:14:11.762042 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c50170ad-2de3-4e45-9566-8e0839bc7c42 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:11.769628 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c50170ad-2de3-4e45-9566-8e0839bc7c42 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.168093 Oct 28 12:14:11.770198 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 112/262] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:11 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:11.841237 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0d255286-8f93-4a51-bef1-621787611c57 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:11.842140 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0d255286-8f93-4a51-bef1-621787611c57 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:11.847889 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0d255286-8f93-4a51-bef1-621787611c57 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:11.848318 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0d255286-8f93-4a51-bef1-621787611c57 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:11.849081 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0d255286-8f93-4a51-bef1-621787611c57 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:11.849542 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0d255286-8f93-4a51-bef1-621787611c57 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:11.925783 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0d255286-8f93-4a51-bef1-621787611c57 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 27894 microversion: 2.20 time: 0.088012 Oct 28 12:14:11.926424 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 113/263] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:11 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 27894 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:14:12.011641 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-30f0270a-89dc-42d5-b729-249daf0bdbfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:14:12.012052 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-30f0270a-89dc-42d5-b729-249daf0bdbfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:14:12.012510 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-30f0270a-89dc-42d5-b729-249daf0bdbfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:14:12.012907 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-30f0270a-89dc-42d5-b729-249daf0bdbfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:14:12.013305 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-30f0270a-89dc-42d5-b729-249daf0bdbfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:14:12.022072 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-30f0270a-89dc-42d5-b729-249daf0bdbfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:12.022513 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-30f0270a-89dc-42d5-b729-249daf0bdbfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:12.023324 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-30f0270a-89dc-42d5-b729-249daf0bdbfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:12.024284 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-30f0270a-89dc-42d5-b729-249daf0bdbfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:12.040246 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-30f0270a-89dc-42d5-b729-249daf0bdbfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Getting quotas for project f032353009b64d738b6c00574846cb51. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:14:12.044022 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-30f0270a-89dc-42d5-b729-249daf0bdbfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Getting quotas for user 27f6b74ea1274a9bba153118ccf63571 and project f032353009b64d738b6c00574846cb51. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:14:12.054522 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-30f0270a-89dc-42d5-b729-249daf0bdbfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:14:12.056886 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-30f0270a-89dc-42d5-b729-249daf0bdbfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4385a199-a3e9-4c11-b580-60e7a24d0e97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:14:12.103402 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-30f0270a-89dc-42d5-b729-249daf0bdbfb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521432 Oct 28 12:14:12.104050 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 151/264] 10.222.0.37 () {60 vars in 1146 bytes} [Thu Oct 28 12:14:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:14:12.114379 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a2eea123-98b4-4982-b446-784aef530524 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:12.115188 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a2eea123-98b4-4982-b446-784aef530524 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:12.168448 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a2eea123-98b4-4982-b446-784aef530524 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:12.175856 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a2eea123-98b4-4982-b446-784aef530524 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1218 microversion: 2.1 time: 0.065463 Oct 28 12:14:12.176667 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 114/265] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:12 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:12.786583 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e8a949f8-6d19-4c3b-b342-ce3f7517de3f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:12.787217 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e8a949f8-6d19-4c3b-b342-ce3f7517de3f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:12.794531 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e8a949f8-6d19-4c3b-b342-ce3f7517de3f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:12.795002 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e8a949f8-6d19-4c3b-b342-ce3f7517de3f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:12.795767 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e8a949f8-6d19-4c3b-b342-ce3f7517de3f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:12.796192 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e8a949f8-6d19-4c3b-b342-ce3f7517de3f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:12.926107 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e8a949f8-6d19-4c3b-b342-ce3f7517de3f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:12.934037 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e8a949f8-6d19-4c3b-b342-ce3f7517de3f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.151055 Oct 28 12:14:12.934591 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 152/266] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:12 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:12.937202 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-094acb04-756a-4f01-b2c1-b306b1bdf5e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:12.938166 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-094acb04-756a-4f01-b2c1-b306b1bdf5e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:12.944710 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-094acb04-756a-4f01-b2c1-b306b1bdf5e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:12.945089 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-094acb04-756a-4f01-b2c1-b306b1bdf5e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:12.946006 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-094acb04-756a-4f01-b2c1-b306b1bdf5e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:12.946439 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-094acb04-756a-4f01-b2c1-b306b1bdf5e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:13.052352 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-094acb04-756a-4f01-b2c1-b306b1bdf5e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28006 microversion: 2.20 time: 0.118551 Oct 28 12:14:13.053212 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 115/267] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:12 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28006 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:14:13.192567 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1d691d3b-d68f-46e9-bc99-99294e4bd564 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:13.193280 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1d691d3b-d68f-46e9-bc99-99294e4bd564 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:13.200734 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1d691d3b-d68f-46e9-bc99-99294e4bd564 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:13.201182 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1d691d3b-d68f-46e9-bc99-99294e4bd564 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:13.201990 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1d691d3b-d68f-46e9-bc99-99294e4bd564 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:13.202362 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1d691d3b-d68f-46e9-bc99-99294e4bd564 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:13.276688 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1d691d3b-d68f-46e9-bc99-99294e4bd564 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:13.283774 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1d691d3b-d68f-46e9-bc99-99294e4bd564 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1276 microversion: 2.1 time: 0.094880 Oct 28 12:14:13.284353 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 153/268] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:13 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1276 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:13.951366 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3bca85f7-6c64-4785-b6fe-5a03a851af62 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:13.952745 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3bca85f7-6c64-4785-b6fe-5a03a851af62 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:13.959285 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3bca85f7-6c64-4785-b6fe-5a03a851af62 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:13.959663 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3bca85f7-6c64-4785-b6fe-5a03a851af62 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:13.960685 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3bca85f7-6c64-4785-b6fe-5a03a851af62 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:13.961662 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3bca85f7-6c64-4785-b6fe-5a03a851af62 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:14.065225 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-82d715c0-6908-4663-a368-b862b364bc36 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:14.066277 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-82d715c0-6908-4663-a368-b862b364bc36 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:14.072798 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-82d715c0-6908-4663-a368-b862b364bc36 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:14.073325 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-82d715c0-6908-4663-a368-b862b364bc36 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:14.074466 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-82d715c0-6908-4663-a368-b862b364bc36 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:14.076520 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-82d715c0-6908-4663-a368-b862b364bc36 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:14.106925 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3bca85f7-6c64-4785-b6fe-5a03a851af62 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:14.114462 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3bca85f7-6c64-4785-b6fe-5a03a851af62 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.167402 Oct 28 12:14:14.117865 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 116/269] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:13 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:14.281487 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-82d715c0-6908-4663-a368-b862b364bc36 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28073 microversion: 2.20 time: 0.220273 Oct 28 12:14:14.282136 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 154/270] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:14 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28073 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:14:14.300892 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fa3e2211-5bd3-4c48-8519-559e307cd0fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:14.301492 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fa3e2211-5bd3-4c48-8519-559e307cd0fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:14.308429 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fa3e2211-5bd3-4c48-8519-559e307cd0fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:14.308874 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fa3e2211-5bd3-4c48-8519-559e307cd0fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:14.309642 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fa3e2211-5bd3-4c48-8519-559e307cd0fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:14.310071 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fa3e2211-5bd3-4c48-8519-559e307cd0fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:14.410898 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-ff37dd33-9c68-4f7f-92bd-c6371cff06e2 req-56af5264-e45a-4efc-96df-aab0e4fbf226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dad0a53-4ae8-40dc-a10f-acae9a07424a", "tag": "3f38fef4-b0dd-45df-aeed-6c7e40ac2d57"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:14.412794 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:14:14.412794 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:14:14.424250 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-ff37dd33-9c68-4f7f-92bd-c6371cff06e2 req-56af5264-e45a-4efc-96df-aab0e4fbf226 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:14.424679 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-ff37dd33-9c68-4f7f-92bd-c6371cff06e2 req-56af5264-e45a-4efc-96df-aab0e4fbf226 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:14.447206 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-ff37dd33-9c68-4f7f-92bd-c6371cff06e2 req-56af5264-e45a-4efc-96df-aab0e4fbf226 service nova] Creating event network-changed:3f38fef4-b0dd-45df-aeed-6c7e40ac2d57 for instance 7dad0a53-4ae8-40dc-a10f-acae9a07424a on hv-cinder-81571 Oct 28 12:14:14.450935 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fa3e2211-5bd3-4c48-8519-559e307cd0fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:14.453980 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-ff37dd33-9c68-4f7f-92bd-c6371cff06e2 req-56af5264-e45a-4efc-96df-aab0e4fbf226 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053783 Oct 28 12:14:14.454915 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 155/271] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:14:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:14:14.464935 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fa3e2211-5bd3-4c48-8519-559e307cd0fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.167694 Oct 28 12:14:14.469828 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a45686e5-9e1e-4b45-8fd1-1e88bdd4e796 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:14.470483 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a45686e5-9e1e-4b45-8fd1-1e88bdd4e796 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:14.474738 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 117/272] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:14 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:14.477812 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a45686e5-9e1e-4b45-8fd1-1e88bdd4e796 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:14.478251 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a45686e5-9e1e-4b45-8fd1-1e88bdd4e796 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:14.479041 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a45686e5-9e1e-4b45-8fd1-1e88bdd4e796 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:14.479552 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a45686e5-9e1e-4b45-8fd1-1e88bdd4e796 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:14.494271 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-a45686e5-9e1e-4b45-8fd1-1e88bdd4e796 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] HTTP exception thrown: Instance 2be58a22-3717-40ff-bd99-40e4eb31b6e8 could not be found. Oct 28 12:14:14.495333 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a45686e5-9e1e-4b45-8fd1-1e88bdd4e796 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Returning 404 to user: Instance 2be58a22-3717-40ff-bd99-40e4eb31b6e8 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:14:14.495906 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a45686e5-9e1e-4b45-8fd1-1e88bdd4e796 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "DELETE /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 404 len: 111 microversion: 2.1 time: 0.030691 Oct 28 12:14:14.496503 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 156/273] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:14:14 2021] DELETE /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 12:14:14.504466 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0eefb93a-5cb4-453b-8e36-509df04e4b48 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:14.505104 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0eefb93a-5cb4-453b-8e36-509df04e4b48 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] [instance: 2be58a22-3717-40ff-bd99-40e4eb31b6e8] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:14.512239 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0eefb93a-5cb4-453b-8e36-509df04e4b48 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:14.512876 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0eefb93a-5cb4-453b-8e36-509df04e4b48 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:14.514024 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0eefb93a-5cb4-453b-8e36-509df04e4b48 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:14.514433 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0eefb93a-5cb4-453b-8e36-509df04e4b48 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:14.530268 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-0eefb93a-5cb4-453b-8e36-509df04e4b48 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] HTTP exception thrown: Instance 2be58a22-3717-40ff-bd99-40e4eb31b6e8 could not be found. Oct 28 12:14:14.531119 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0eefb93a-5cb4-453b-8e36-509df04e4b48 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] Returning 404 to user: Instance 2be58a22-3717-40ff-bd99-40e4eb31b6e8 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:14:14.531944 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0eefb93a-5cb4-453b-8e36-509df04e4b48 tempest-DeleteServersTestJSON-876145187 tempest-DeleteServersTestJSON-876145187-project] 10.222.0.37 "GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8" status: 404 len: 111 microversion: 2.1 time: 0.031255 Oct 28 12:14:14.532533 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 118/274] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:14 2021] GET /compute/v2.1/servers/2be58a22-3717-40ff-bd99-40e4eb31b6e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:14:15.130940 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5ac408d2-23b6-45b2-a896-373090101ede tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:15.132109 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5ac408d2-23b6-45b2-a896-373090101ede tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:15.139283 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ac408d2-23b6-45b2-a896-373090101ede tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:15.139785 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ac408d2-23b6-45b2-a896-373090101ede tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:15.140566 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ac408d2-23b6-45b2-a896-373090101ede tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:15.141006 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ac408d2-23b6-45b2-a896-373090101ede tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:15.294076 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-646b6df8-49ae-4a71-a14f-d79c16d2be24 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:15.295533 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-646b6df8-49ae-4a71-a14f-d79c16d2be24 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:15.304364 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-646b6df8-49ae-4a71-a14f-d79c16d2be24 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:15.305578 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-646b6df8-49ae-4a71-a14f-d79c16d2be24 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:15.306398 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-646b6df8-49ae-4a71-a14f-d79c16d2be24 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:15.306871 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-646b6df8-49ae-4a71-a14f-d79c16d2be24 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:15.372669 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5ac408d2-23b6-45b2-a896-373090101ede tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:15.384648 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5ac408d2-23b6-45b2-a896-373090101ede tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.257149 Oct 28 12:14:15.385229 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 157/275] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:15 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:15.482632 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-524ce88f-1cc1-42d0-a4af-56ade2ba8850 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:15.483500 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-524ce88f-1cc1-42d0-a4af-56ade2ba8850 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:15.490508 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-524ce88f-1cc1-42d0-a4af-56ade2ba8850 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:15.491334 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-524ce88f-1cc1-42d0-a4af-56ade2ba8850 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:15.492446 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-524ce88f-1cc1-42d0-a4af-56ade2ba8850 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:15.493208 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-524ce88f-1cc1-42d0-a4af-56ade2ba8850 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:15.533889 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-646b6df8-49ae-4a71-a14f-d79c16d2be24 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.243697 Oct 28 12:14:15.535177 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 119/276] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:15 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:14:15.711759 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-524ce88f-1cc1-42d0-a4af-56ade2ba8850 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:15.719103 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-524ce88f-1cc1-42d0-a4af-56ade2ba8850 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.240928 Oct 28 12:14:15.719690 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 158/277] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:15 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:16.402839 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dc94b0d9-69d0-47ec-b22b-468da9b262ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:16.403531 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dc94b0d9-69d0-47ec-b22b-468da9b262ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:16.414496 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc94b0d9-69d0-47ec-b22b-468da9b262ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:16.414941 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc94b0d9-69d0-47ec-b22b-468da9b262ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:16.415722 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc94b0d9-69d0-47ec-b22b-468da9b262ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:16.416157 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc94b0d9-69d0-47ec-b22b-468da9b262ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:16.547680 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4727078f-e0c4-4ad0-a7d2-e0235ea42d62 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:16.549616 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4727078f-e0c4-4ad0-a7d2-e0235ea42d62 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:16.560684 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4727078f-e0c4-4ad0-a7d2-e0235ea42d62 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:16.561341 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4727078f-e0c4-4ad0-a7d2-e0235ea42d62 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:16.562126 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4727078f-e0c4-4ad0-a7d2-e0235ea42d62 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:16.563053 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4727078f-e0c4-4ad0-a7d2-e0235ea42d62 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:16.567024 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-dc94b0d9-69d0-47ec-b22b-468da9b262ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:16.575718 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dc94b0d9-69d0-47ec-b22b-468da9b262ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.177766 Oct 28 12:14:16.577041 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 120/278] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:16 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:16.714326 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4727078f-e0c4-4ad0-a7d2-e0235ea42d62 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.171361 Oct 28 12:14:16.716159 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 159/279] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:16 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:14:16.736390 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-aef424f5-503c-40a2-8d94-58d486057975 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:16.737134 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-aef424f5-503c-40a2-8d94-58d486057975 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:16.745643 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aef424f5-503c-40a2-8d94-58d486057975 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:16.746287 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aef424f5-503c-40a2-8d94-58d486057975 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:16.747097 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aef424f5-503c-40a2-8d94-58d486057975 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:16.747533 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aef424f5-503c-40a2-8d94-58d486057975 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:16.905659 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-aef424f5-503c-40a2-8d94-58d486057975 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:16.917386 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-aef424f5-503c-40a2-8d94-58d486057975 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.185454 Oct 28 12:14:16.917919 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 121/280] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:16 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:17.592624 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-70b7aafb-3239-4ab5-b1d2-62d4008b3a68 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:17.593483 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-70b7aafb-3239-4ab5-b1d2-62d4008b3a68 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:17.600983 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-70b7aafb-3239-4ab5-b1d2-62d4008b3a68 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:17.601621 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-70b7aafb-3239-4ab5-b1d2-62d4008b3a68 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:17.602383 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-70b7aafb-3239-4ab5-b1d2-62d4008b3a68 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:17.603004 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-70b7aafb-3239-4ab5-b1d2-62d4008b3a68 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:17.726607 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8050a174-8650-48a1-a0e9-acdcb740971c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:17.727670 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8050a174-8650-48a1-a0e9-acdcb740971c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:17.739490 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-70b7aafb-3239-4ab5-b1d2-62d4008b3a68 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:17.749424 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8050a174-8650-48a1-a0e9-acdcb740971c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:17.749424 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8050a174-8650-48a1-a0e9-acdcb740971c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:17.750131 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8050a174-8650-48a1-a0e9-acdcb740971c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:17.750131 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8050a174-8650-48a1-a0e9-acdcb740971c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:17.753430 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-70b7aafb-3239-4ab5-b1d2-62d4008b3a68 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.164527 Oct 28 12:14:17.754004 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 160/281] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:17 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:17.934610 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8050a174-8650-48a1-a0e9-acdcb740971c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.211586 Oct 28 12:14:17.936197 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 122/282] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:17 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:14:17.936591 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3543afe0-f444-45b5-907f-f3a39e500d69 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:17.937457 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3543afe0-f444-45b5-907f-f3a39e500d69 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:17.944413 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3543afe0-f444-45b5-907f-f3a39e500d69 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:17.946068 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3543afe0-f444-45b5-907f-f3a39e500d69 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:17.947280 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3543afe0-f444-45b5-907f-f3a39e500d69 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:17.949287 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3543afe0-f444-45b5-907f-f3a39e500d69 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:18.177336 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3543afe0-f444-45b5-907f-f3a39e500d69 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:18.188526 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3543afe0-f444-45b5-907f-f3a39e500d69 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.257335 Oct 28 12:14:18.200605 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 161/283] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:17 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:18.770535 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c94af58a-4037-49ea-a184-4c2b7fa62eef tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:18.771909 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c94af58a-4037-49ea-a184-4c2b7fa62eef tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:18.779616 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c94af58a-4037-49ea-a184-4c2b7fa62eef tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:18.780410 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c94af58a-4037-49ea-a184-4c2b7fa62eef tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:18.781436 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c94af58a-4037-49ea-a184-4c2b7fa62eef tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:18.782066 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c94af58a-4037-49ea-a184-4c2b7fa62eef tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:18.939579 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c94af58a-4037-49ea-a184-4c2b7fa62eef tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:18.950335 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a24e400b-f911-409e-9eaf-0fbf7a64a992 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:18.950335 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a24e400b-f911-409e-9eaf-0fbf7a64a992 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:18.952759 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c94af58a-4037-49ea-a184-4c2b7fa62eef tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.186443 Oct 28 12:14:18.956565 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 123/284] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:18 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:18.975576 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a24e400b-f911-409e-9eaf-0fbf7a64a992 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:18.976307 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a24e400b-f911-409e-9eaf-0fbf7a64a992 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:18.977310 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a24e400b-f911-409e-9eaf-0fbf7a64a992 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:18.978376 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a24e400b-f911-409e-9eaf-0fbf7a64a992 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:19.207744 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9be123e1-5cfd-4fd3-9d9f-16934454d4f2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:19.208588 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9be123e1-5cfd-4fd3-9d9f-16934454d4f2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:19.215930 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9be123e1-5cfd-4fd3-9d9f-16934454d4f2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:19.216605 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9be123e1-5cfd-4fd3-9d9f-16934454d4f2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:19.217536 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9be123e1-5cfd-4fd3-9d9f-16934454d4f2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:19.218119 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9be123e1-5cfd-4fd3-9d9f-16934454d4f2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:19.260279 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a24e400b-f911-409e-9eaf-0fbf7a64a992 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.315236 Oct 28 12:14:19.260978 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 162/285] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:18 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:14:19.364285 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9be123e1-5cfd-4fd3-9d9f-16934454d4f2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:19.372094 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9be123e1-5cfd-4fd3-9d9f-16934454d4f2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.167769 Oct 28 12:14:19.373248 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 124/286] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:19 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:19.971735 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-74f07962-f4d6-4137-8a8a-91b978cb413b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:19.973109 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-74f07962-f4d6-4137-8a8a-91b978cb413b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:19.981884 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-74f07962-f4d6-4137-8a8a-91b978cb413b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:19.982567 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-74f07962-f4d6-4137-8a8a-91b978cb413b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:19.984679 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-74f07962-f4d6-4137-8a8a-91b978cb413b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:19.985176 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-74f07962-f4d6-4137-8a8a-91b978cb413b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:20.136201 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-74f07962-f4d6-4137-8a8a-91b978cb413b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:20.144513 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-74f07962-f4d6-4137-8a8a-91b978cb413b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.176849 Oct 28 12:14:20.145600 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 163/287] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:19 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:20.272914 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9e1c9d70-24cd-4ef7-87b2-870f17d3c7d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:20.274347 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9e1c9d70-24cd-4ef7-87b2-870f17d3c7d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:20.281499 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9e1c9d70-24cd-4ef7-87b2-870f17d3c7d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:20.282102 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9e1c9d70-24cd-4ef7-87b2-870f17d3c7d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:20.283082 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9e1c9d70-24cd-4ef7-87b2-870f17d3c7d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:20.283613 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9e1c9d70-24cd-4ef7-87b2-870f17d3c7d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:20.371334 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9e1c9d70-24cd-4ef7-87b2-870f17d3c7d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.102247 Oct 28 12:14:20.372532 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 125/288] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:20 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:14:20.390200 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b699cac2-c1a7-4043-9ec1-8ed40a0f0314 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:20.390978 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b699cac2-c1a7-4043-9ec1-8ed40a0f0314 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:20.402581 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b699cac2-c1a7-4043-9ec1-8ed40a0f0314 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:20.403761 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b699cac2-c1a7-4043-9ec1-8ed40a0f0314 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:20.404553 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b699cac2-c1a7-4043-9ec1-8ed40a0f0314 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:20.404984 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b699cac2-c1a7-4043-9ec1-8ed40a0f0314 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:20.564320 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b699cac2-c1a7-4043-9ec1-8ed40a0f0314 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:20.573281 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b699cac2-c1a7-4043-9ec1-8ed40a0f0314 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.187728 Oct 28 12:14:20.573840 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 164/289] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:20 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:21.164182 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-024b00b7-647c-43ec-b932-f77bfcd8dd8c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:21.165072 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-024b00b7-647c-43ec-b932-f77bfcd8dd8c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:21.172798 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-024b00b7-647c-43ec-b932-f77bfcd8dd8c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:21.173391 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-024b00b7-647c-43ec-b932-f77bfcd8dd8c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:21.174266 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-024b00b7-647c-43ec-b932-f77bfcd8dd8c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:21.174843 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-024b00b7-647c-43ec-b932-f77bfcd8dd8c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:21.358840 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-024b00b7-647c-43ec-b932-f77bfcd8dd8c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:21.366233 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-024b00b7-647c-43ec-b932-f77bfcd8dd8c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1522 microversion: 2.1 time: 0.206231 Oct 28 12:14:21.367334 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 126/290] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:21 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:21.382150 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-93afb7ff-52ea-4aae-8608-45a172b5dbaf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:21.383862 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-93afb7ff-52ea-4aae-8608-45a172b5dbaf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:21.392524 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93afb7ff-52ea-4aae-8608-45a172b5dbaf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:21.393317 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93afb7ff-52ea-4aae-8608-45a172b5dbaf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:21.395010 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93afb7ff-52ea-4aae-8608-45a172b5dbaf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:21.395551 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93afb7ff-52ea-4aae-8608-45a172b5dbaf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:21.589009 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-10fc8559-f819-4171-be73-170f8c26458b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:21.589610 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-10fc8559-f819-4171-be73-170f8c26458b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:21.595891 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-10fc8559-f819-4171-be73-170f8c26458b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:21.596334 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-10fc8559-f819-4171-be73-170f8c26458b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:21.597101 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-10fc8559-f819-4171-be73-170f8c26458b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:21.597531 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-10fc8559-f819-4171-be73-170f8c26458b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:21.597638 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-93afb7ff-52ea-4aae-8608-45a172b5dbaf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.218804 Oct 28 12:14:21.599938 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 165/291] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:21 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:14:21.717578 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-10fc8559-f819-4171-be73-170f8c26458b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:21.725284 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-10fc8559-f819-4171-be73-170f8c26458b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.139836 Oct 28 12:14:21.725864 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 127/292] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:21 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:22.384043 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-98d9659f-5e59-47a4-b67b-d3ed9e7d424d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:22.384735 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-98d9659f-5e59-47a4-b67b-d3ed9e7d424d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:22.391517 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-98d9659f-5e59-47a4-b67b-d3ed9e7d424d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:22.391962 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-98d9659f-5e59-47a4-b67b-d3ed9e7d424d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:22.392723 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-98d9659f-5e59-47a4-b67b-d3ed9e7d424d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:22.393151 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-98d9659f-5e59-47a4-b67b-d3ed9e7d424d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:22.529543 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-98d9659f-5e59-47a4-b67b-d3ed9e7d424d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:22.536824 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-98d9659f-5e59-47a4-b67b-d3ed9e7d424d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1502 microversion: 2.1 time: 0.156774 Oct 28 12:14:22.537390 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 166/293] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:22 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:22.553074 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c62f1e93-0cb1-4f91-8e18-d08225301d07 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:22.553762 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c62f1e93-0cb1-4f91-8e18-d08225301d07 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:22.560389 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c62f1e93-0cb1-4f91-8e18-d08225301d07 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:22.560722 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c62f1e93-0cb1-4f91-8e18-d08225301d07 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:22.561621 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c62f1e93-0cb1-4f91-8e18-d08225301d07 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:22.562107 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c62f1e93-0cb1-4f91-8e18-d08225301d07 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:22.610043 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a526cf3a-e83e-48ad-8106-ae3e93982607 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:22.611258 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a526cf3a-e83e-48ad-8106-ae3e93982607 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:22.618035 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a526cf3a-e83e-48ad-8106-ae3e93982607 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:22.618494 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a526cf3a-e83e-48ad-8106-ae3e93982607 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:22.619277 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a526cf3a-e83e-48ad-8106-ae3e93982607 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:22.619739 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a526cf3a-e83e-48ad-8106-ae3e93982607 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:22.689818 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c62f1e93-0cb1-4f91-8e18-d08225301d07 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:22.697275 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c62f1e93-0cb1-4f91-8e18-d08225301d07 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1515 microversion: 2.1 time: 0.147944 Oct 28 12:14:22.697854 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 128/294] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:22 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:22.699929 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a526cf3a-e83e-48ad-8106-ae3e93982607 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.094272 Oct 28 12:14:22.701081 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 167/295] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:22 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:14:22.741325 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f53b7f5e-2799-4794-af8b-3ba939d2a6df tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:22.742626 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f53b7f5e-2799-4794-af8b-3ba939d2a6df tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:22.748579 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f53b7f5e-2799-4794-af8b-3ba939d2a6df tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:22.749023 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f53b7f5e-2799-4794-af8b-3ba939d2a6df tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:22.749791 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f53b7f5e-2799-4794-af8b-3ba939d2a6df tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:22.750225 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f53b7f5e-2799-4794-af8b-3ba939d2a6df tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:22.874947 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f53b7f5e-2799-4794-af8b-3ba939d2a6df tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:22.882195 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f53b7f5e-2799-4794-af8b-3ba939d2a6df tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.144444 Oct 28 12:14:22.883462 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 129/296] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:22 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:23.712056 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-274f154c-5c6d-4c5e-8838-f0c7452b036c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:23.713075 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-274f154c-5c6d-4c5e-8838-f0c7452b036c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:23.720065 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-274f154c-5c6d-4c5e-8838-f0c7452b036c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:23.720508 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-274f154c-5c6d-4c5e-8838-f0c7452b036c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:23.721290 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-274f154c-5c6d-4c5e-8838-f0c7452b036c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:23.721721 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-274f154c-5c6d-4c5e-8838-f0c7452b036c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:23.794948 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-274f154c-5c6d-4c5e-8838-f0c7452b036c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.086874 Oct 28 12:14:23.795577 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 168/297] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:23 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:14:23.898740 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ef1a7ed4-16fe-4b69-8bbf-4e8409a4739f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:23.899347 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ef1a7ed4-16fe-4b69-8bbf-4e8409a4739f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:23.905536 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ef1a7ed4-16fe-4b69-8bbf-4e8409a4739f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:23.905983 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ef1a7ed4-16fe-4b69-8bbf-4e8409a4739f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:23.906837 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ef1a7ed4-16fe-4b69-8bbf-4e8409a4739f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:23.907278 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ef1a7ed4-16fe-4b69-8bbf-4e8409a4739f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:24.032086 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ef1a7ed4-16fe-4b69-8bbf-4e8409a4739f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:24.039789 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ef1a7ed4-16fe-4b69-8bbf-4e8409a4739f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.144693 Oct 28 12:14:24.040344 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 130/298] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:23 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:24.807025 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-213fd88e-4bcd-4b8b-93d3-9497cf2ef48b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:24.807920 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-213fd88e-4bcd-4b8b-93d3-9497cf2ef48b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:24.814524 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-213fd88e-4bcd-4b8b-93d3-9497cf2ef48b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:24.815005 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-213fd88e-4bcd-4b8b-93d3-9497cf2ef48b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:24.815760 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-213fd88e-4bcd-4b8b-93d3-9497cf2ef48b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:24.816215 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-213fd88e-4bcd-4b8b-93d3-9497cf2ef48b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:25.057119 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2e1b0621-0ff7-413c-b8b6-50abf6750e2f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:25.057662 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2e1b0621-0ff7-413c-b8b6-50abf6750e2f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:25.063805 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2e1b0621-0ff7-413c-b8b6-50abf6750e2f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:25.064245 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2e1b0621-0ff7-413c-b8b6-50abf6750e2f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:25.065004 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2e1b0621-0ff7-413c-b8b6-50abf6750e2f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:25.065429 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2e1b0621-0ff7-413c-b8b6-50abf6750e2f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:25.191376 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2e1b0621-0ff7-413c-b8b6-50abf6750e2f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:25.198561 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2e1b0621-0ff7-413c-b8b6-50abf6750e2f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.145648 Oct 28 12:14:25.199255 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 131/299] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:25 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:26.216629 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ee73bb46-c1bf-4f33-9b1b-49182b058646 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:26.217255 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ee73bb46-c1bf-4f33-9b1b-49182b058646 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:26.223438 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee73bb46-c1bf-4f33-9b1b-49182b058646 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:26.223880 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee73bb46-c1bf-4f33-9b1b-49182b058646 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:26.224630 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee73bb46-c1bf-4f33-9b1b-49182b058646 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:26.225053 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee73bb46-c1bf-4f33-9b1b-49182b058646 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:26.343476 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ee73bb46-c1bf-4f33-9b1b-49182b058646 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:26.350708 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ee73bb46-c1bf-4f33-9b1b-49182b058646 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.137662 Oct 28 12:14:26.351959 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 132/300] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:26 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:27.050828 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-063c7620-5b5b-48ce-8735-be77217be438 req-d9bc5656-8a90-4977-ab69-13882323f491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dad0a53-4ae8-40dc-a10f-acae9a07424a", "name": "network-vif-plugged", "status": "completed", "tag": "3f38fef4-b0dd-45df-aeed-6c7e40ac2d57"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:27.052315 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:14:27.052315 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:14:27.059034 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-063c7620-5b5b-48ce-8735-be77217be438 req-d9bc5656-8a90-4977-ab69-13882323f491 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:27.059456 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-063c7620-5b5b-48ce-8735-be77217be438 req-d9bc5656-8a90-4977-ab69-13882323f491 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:27.070588 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-063c7620-5b5b-48ce-8735-be77217be438 req-d9bc5656-8a90-4977-ab69-13882323f491 service nova] Creating event network-vif-plugged:3f38fef4-b0dd-45df-aeed-6c7e40ac2d57 for instance 7dad0a53-4ae8-40dc-a10f-acae9a07424a on hv-cinder-81571 Oct 28 12:14:27.075247 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-063c7620-5b5b-48ce-8735-be77217be438 req-d9bc5656-8a90-4977-ab69-13882323f491 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028034 Oct 28 12:14:27.075825 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 133/301] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:14:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:14:27.368872 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9d688014-1cfa-4f59-9f12-743671666495 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:27.369558 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9d688014-1cfa-4f59-9f12-743671666495 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:27.375829 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d688014-1cfa-4f59-9f12-743671666495 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:27.376292 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d688014-1cfa-4f59-9f12-743671666495 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:27.377050 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d688014-1cfa-4f59-9f12-743671666495 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:27.377484 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d688014-1cfa-4f59-9f12-743671666495 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:27.500678 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9d688014-1cfa-4f59-9f12-743671666495 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:27.508384 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9d688014-1cfa-4f59-9f12-743671666495 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.144423 Oct 28 12:14:27.508947 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 134/302] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:27 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:28.524263 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5a52a2eb-1261-4de7-8ac7-b97b4b74f935 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:28.524880 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5a52a2eb-1261-4de7-8ac7-b97b4b74f935 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:28.530973 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5a52a2eb-1261-4de7-8ac7-b97b4b74f935 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:28.531413 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5a52a2eb-1261-4de7-8ac7-b97b4b74f935 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:28.532166 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5a52a2eb-1261-4de7-8ac7-b97b4b74f935 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:28.532586 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5a52a2eb-1261-4de7-8ac7-b97b4b74f935 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:28.824513 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5a52a2eb-1261-4de7-8ac7-b97b4b74f935 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:28.831992 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5a52a2eb-1261-4de7-8ac7-b97b4b74f935 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.311513 Oct 28 12:14:28.832568 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 135/303] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:28 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:29.848852 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5a5f9e6d-dba7-45b9-93bf-f82ee33819f8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:29.849441 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5a5f9e6d-dba7-45b9-93bf-f82ee33819f8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:29.855603 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5a5f9e6d-dba7-45b9-93bf-f82ee33819f8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:29.856117 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5a5f9e6d-dba7-45b9-93bf-f82ee33819f8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:29.856864 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5a5f9e6d-dba7-45b9-93bf-f82ee33819f8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:29.857287 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5a5f9e6d-dba7-45b9-93bf-f82ee33819f8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:29.977868 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5a5f9e6d-dba7-45b9-93bf-f82ee33819f8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:29.985379 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5a5f9e6d-dba7-45b9-93bf-f82ee33819f8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.139995 Oct 28 12:14:29.985949 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 136/304] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:29 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:31.002329 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-83625c22-00eb-45fc-ac0d-ed2bcbcb1e5c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:31.002991 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-83625c22-00eb-45fc-ac0d-ed2bcbcb1e5c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:31.009822 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-83625c22-00eb-45fc-ac0d-ed2bcbcb1e5c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:31.010267 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-83625c22-00eb-45fc-ac0d-ed2bcbcb1e5c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:31.011061 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-83625c22-00eb-45fc-ac0d-ed2bcbcb1e5c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:31.011490 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-83625c22-00eb-45fc-ac0d-ed2bcbcb1e5c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:31.130343 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-83625c22-00eb-45fc-ac0d-ed2bcbcb1e5c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:31.137615 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-83625c22-00eb-45fc-ac0d-ed2bcbcb1e5c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.138997 Oct 28 12:14:31.138176 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 137/305] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:30 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:31.439181 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-213fd88e-4bcd-4b8b-93d3-9497cf2ef48b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 6.636670 Oct 28 12:14:31.440257 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 169/306] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:24 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 6639 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:14:32.153580 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f5f1b55c-83f7-4e2d-883f-70a0fda944e0 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:32.154186 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f5f1b55c-83f7-4e2d-883f-70a0fda944e0 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:32.160506 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f5f1b55c-83f7-4e2d-883f-70a0fda944e0 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:32.160953 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f5f1b55c-83f7-4e2d-883f-70a0fda944e0 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:32.161714 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f5f1b55c-83f7-4e2d-883f-70a0fda944e0 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:32.162141 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f5f1b55c-83f7-4e2d-883f-70a0fda944e0 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:32.281615 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f5f1b55c-83f7-4e2d-883f-70a0fda944e0 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:32.288797 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f5f1b55c-83f7-4e2d-883f-70a0fda944e0 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.138835 Oct 28 12:14:32.289360 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 138/307] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:32 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:32.451315 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2b67c3cf-484e-4217-a547-731c214eee0b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:32.452290 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2b67c3cf-484e-4217-a547-731c214eee0b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:32.459141 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2b67c3cf-484e-4217-a547-731c214eee0b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:32.459572 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2b67c3cf-484e-4217-a547-731c214eee0b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:32.460811 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2b67c3cf-484e-4217-a547-731c214eee0b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:32.461240 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2b67c3cf-484e-4217-a547-731c214eee0b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:32.559202 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2b67c3cf-484e-4217-a547-731c214eee0b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.111781 Oct 28 12:14:32.560069 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 170/308] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:32 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:14:33.306205 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ac7a03c2-5ab4-41ab-a526-729d1cbd8453 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:33.306837 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ac7a03c2-5ab4-41ab-a526-729d1cbd8453 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:33.312999 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ac7a03c2-5ab4-41ab-a526-729d1cbd8453 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:33.313436 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ac7a03c2-5ab4-41ab-a526-729d1cbd8453 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:33.314186 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ac7a03c2-5ab4-41ab-a526-729d1cbd8453 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:33.314753 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ac7a03c2-5ab4-41ab-a526-729d1cbd8453 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:33.434932 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ac7a03c2-5ab4-41ab-a526-729d1cbd8453 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:33.442236 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ac7a03c2-5ab4-41ab-a526-729d1cbd8453 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.140280 Oct 28 12:14:33.442831 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 139/309] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:33 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:33.498288 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0a9f21d0-d09d-4ea9-aa68-a798aa971a6e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:33.499338 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0a9f21d0-d09d-4ea9-aa68-a798aa971a6e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:33.506074 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0a9f21d0-d09d-4ea9-aa68-a798aa971a6e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:33.506516 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0a9f21d0-d09d-4ea9-aa68-a798aa971a6e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:33.507355 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0a9f21d0-d09d-4ea9-aa68-a798aa971a6e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:33.507787 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0a9f21d0-d09d-4ea9-aa68-a798aa971a6e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:33.530935 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-0a9f21d0-d09d-4ea9-aa68-a798aa971a6e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lazy-loading 'flavor' on Instance uuid 28b1cf11-e525-409b-83da-1c26e1d9937d {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:14:33.571442 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4e5e325a-daf9-4a29-94d5-44df7145ecea tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:33.572422 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4e5e325a-daf9-4a29-94d5-44df7145ecea tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:33.578732 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e5e325a-daf9-4a29-94d5-44df7145ecea tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:33.579184 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e5e325a-daf9-4a29-94d5-44df7145ecea tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:33.579989 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e5e325a-daf9-4a29-94d5-44df7145ecea tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:33.580414 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e5e325a-daf9-4a29-94d5-44df7145ecea tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:33.642626 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0a9f21d0-d09d-4ea9-aa68-a798aa971a6e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "POST /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/action" status: 200 len: 32 microversion: 2.1 time: 0.148351 Oct 28 12:14:33.643259 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 171/310] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:14:33 2021] POST /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/action => generated 32 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:14:33.652128 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c09d75b7-4b61-4878-a8a3-8543a816cd68 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:33.652815 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c09d75b7-4b61-4878-a8a3-8543a816cd68 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:33.659753 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c09d75b7-4b61-4878-a8a3-8543a816cd68 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:33.660270 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c09d75b7-4b61-4878-a8a3-8543a816cd68 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:33.661045 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c09d75b7-4b61-4878-a8a3-8543a816cd68 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:33.661474 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c09d75b7-4b61-4878-a8a3-8543a816cd68 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:33.860664 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c09d75b7-4b61-4878-a8a3-8543a816cd68 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:33.869294 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c09d75b7-4b61-4878-a8a3-8543a816cd68 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.220771 Oct 28 12:14:33.870057 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 172/311] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:33 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:33.944332 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4e5e325a-daf9-4a29-94d5-44df7145ecea tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.376581 Oct 28 12:14:33.945665 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 140/312] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:33 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:14:34.459289 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c9a6205b-e3e1-42cf-bdf4-b839480cd182 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:34.459910 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c9a6205b-e3e1-42cf-bdf4-b839480cd182 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:34.466500 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c9a6205b-e3e1-42cf-bdf4-b839480cd182 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:34.466966 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c9a6205b-e3e1-42cf-bdf4-b839480cd182 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:34.467715 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c9a6205b-e3e1-42cf-bdf4-b839480cd182 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:34.468136 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c9a6205b-e3e1-42cf-bdf4-b839480cd182 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:34.590876 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c9a6205b-e3e1-42cf-bdf4-b839480cd182 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:34.598018 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c9a6205b-e3e1-42cf-bdf4-b839480cd182 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.142477 Oct 28 12:14:34.598580 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 173/313] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:34 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:34.887505 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-528e6a17-995f-4c2d-9536-5d69ac29ba23 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:34.888202 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-528e6a17-995f-4c2d-9536-5d69ac29ba23 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:34.895093 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-528e6a17-995f-4c2d-9536-5d69ac29ba23 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:34.895542 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-528e6a17-995f-4c2d-9536-5d69ac29ba23 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:34.896304 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-528e6a17-995f-4c2d-9536-5d69ac29ba23 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:34.896730 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-528e6a17-995f-4c2d-9536-5d69ac29ba23 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:34.957524 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-383a9204-4ec4-4227-8314-3876d53291ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:34.958444 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-383a9204-4ec4-4227-8314-3876d53291ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:34.965450 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-383a9204-4ec4-4227-8314-3876d53291ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:34.965886 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-383a9204-4ec4-4227-8314-3876d53291ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:34.966645 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-383a9204-4ec4-4227-8314-3876d53291ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:34.967401 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-383a9204-4ec4-4227-8314-3876d53291ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:35.024880 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-528e6a17-995f-4c2d-9536-5d69ac29ba23 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:35.033022 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-528e6a17-995f-4c2d-9536-5d69ac29ba23 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.150014 Oct 28 12:14:35.033585 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 141/314] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:34 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:35.615416 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a0550845-8eed-4fbc-82a5-9cab86eb9a84 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:35.616142 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a0550845-8eed-4fbc-82a5-9cab86eb9a84 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:35.622906 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a0550845-8eed-4fbc-82a5-9cab86eb9a84 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:35.623352 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a0550845-8eed-4fbc-82a5-9cab86eb9a84 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:35.624104 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a0550845-8eed-4fbc-82a5-9cab86eb9a84 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:35.624527 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a0550845-8eed-4fbc-82a5-9cab86eb9a84 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:35.745909 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a0550845-8eed-4fbc-82a5-9cab86eb9a84 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:35.752947 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a0550845-8eed-4fbc-82a5-9cab86eb9a84 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.141203 Oct 28 12:14:35.753509 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 142/315] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:35 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:36.050482 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e4ed5dd1-19b5-4853-accb-855ee1b03165 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:36.051135 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e4ed5dd1-19b5-4853-accb-855ee1b03165 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:36.057484 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e4ed5dd1-19b5-4853-accb-855ee1b03165 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:36.057930 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e4ed5dd1-19b5-4853-accb-855ee1b03165 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:36.058896 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e4ed5dd1-19b5-4853-accb-855ee1b03165 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:36.059328 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e4ed5dd1-19b5-4853-accb-855ee1b03165 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:36.184850 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e4ed5dd1-19b5-4853-accb-855ee1b03165 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:36.192193 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e4ed5dd1-19b5-4853-accb-855ee1b03165 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.145639 Oct 28 12:14:36.192759 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 143/316] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:36 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:36.769310 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c821aded-9b20-4e06-b4f3-e7078a3762e9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:36.769815 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c821aded-9b20-4e06-b4f3-e7078a3762e9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:36.776557 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c821aded-9b20-4e06-b4f3-e7078a3762e9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:36.777021 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c821aded-9b20-4e06-b4f3-e7078a3762e9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:36.777774 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c821aded-9b20-4e06-b4f3-e7078a3762e9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:36.778193 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c821aded-9b20-4e06-b4f3-e7078a3762e9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:36.905371 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c821aded-9b20-4e06-b4f3-e7078a3762e9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:36.913145 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c821aded-9b20-4e06-b4f3-e7078a3762e9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.147518 Oct 28 12:14:36.913708 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 144/317] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:36 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:37.211029 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-59abb82a-6cfc-4b1e-ad25-744d1960a7c4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:37.211639 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-59abb82a-6cfc-4b1e-ad25-744d1960a7c4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:37.218399 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59abb82a-6cfc-4b1e-ad25-744d1960a7c4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:37.219046 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59abb82a-6cfc-4b1e-ad25-744d1960a7c4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:37.224416 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59abb82a-6cfc-4b1e-ad25-744d1960a7c4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:37.224416 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59abb82a-6cfc-4b1e-ad25-744d1960a7c4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:37.351688 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-59abb82a-6cfc-4b1e-ad25-744d1960a7c4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:37.359367 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-59abb82a-6cfc-4b1e-ad25-744d1960a7c4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.152396 Oct 28 12:14:37.359937 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 145/318] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:37 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:37.930077 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-22428712-1f39-4ca8-87fa-0827b0a50bb6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:37.931532 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-22428712-1f39-4ca8-87fa-0827b0a50bb6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:37.937717 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-22428712-1f39-4ca8-87fa-0827b0a50bb6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:37.938142 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-22428712-1f39-4ca8-87fa-0827b0a50bb6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:37.938933 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-22428712-1f39-4ca8-87fa-0827b0a50bb6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:37.939361 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-22428712-1f39-4ca8-87fa-0827b0a50bb6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:38.057260 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-22428712-1f39-4ca8-87fa-0827b0a50bb6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:38.064514 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-22428712-1f39-4ca8-87fa-0827b0a50bb6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.138028 Oct 28 12:14:38.065080 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 146/319] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:37 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:38.376532 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5027518c-e3f0-43c6-a3ea-3aa27e6e4ae6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:38.377120 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5027518c-e3f0-43c6-a3ea-3aa27e6e4ae6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:38.383155 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5027518c-e3f0-43c6-a3ea-3aa27e6e4ae6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:38.383530 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5027518c-e3f0-43c6-a3ea-3aa27e6e4ae6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:38.384404 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5027518c-e3f0-43c6-a3ea-3aa27e6e4ae6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:38.384824 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5027518c-e3f0-43c6-a3ea-3aa27e6e4ae6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:38.503245 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5027518c-e3f0-43c6-a3ea-3aa27e6e4ae6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:38.511010 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5027518c-e3f0-43c6-a3ea-3aa27e6e4ae6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.138251 Oct 28 12:14:38.511573 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 147/320] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:38 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:39.080832 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5da64209-2bca-406a-bdc3-e5f8bf3e69fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:39.081437 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5da64209-2bca-406a-bdc3-e5f8bf3e69fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:39.087618 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5da64209-2bca-406a-bdc3-e5f8bf3e69fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:39.088065 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5da64209-2bca-406a-bdc3-e5f8bf3e69fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:39.088831 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5da64209-2bca-406a-bdc3-e5f8bf3e69fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:39.089262 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5da64209-2bca-406a-bdc3-e5f8bf3e69fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:39.211391 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5da64209-2bca-406a-bdc3-e5f8bf3e69fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:39.219266 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5da64209-2bca-406a-bdc3-e5f8bf3e69fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.141708 Oct 28 12:14:39.219608 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 148/321] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:39 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:39.527685 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7dcde3b2-0950-4303-baa8-a2f6317ff2b2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:39.528289 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7dcde3b2-0950-4303-baa8-a2f6317ff2b2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:39.534039 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7dcde3b2-0950-4303-baa8-a2f6317ff2b2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:39.534484 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7dcde3b2-0950-4303-baa8-a2f6317ff2b2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:39.535268 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7dcde3b2-0950-4303-baa8-a2f6317ff2b2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:39.535700 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7dcde3b2-0950-4303-baa8-a2f6317ff2b2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:39.653819 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7dcde3b2-0950-4303-baa8-a2f6317ff2b2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:39.661083 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7dcde3b2-0950-4303-baa8-a2f6317ff2b2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.137156 Oct 28 12:14:39.661645 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 149/322] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:39 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:40.201564 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-383a9204-4ec4-4227-8314-3876d53291ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 5.248067 Oct 28 12:14:40.205411 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 174/323] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:34 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 5250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:14:40.235712 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-13c3a915-5928-403f-aaf6-7d2950b2c4ea tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:40.236346 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-13c3a915-5928-403f-aaf6-7d2950b2c4ea tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:40.242615 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-13c3a915-5928-403f-aaf6-7d2950b2c4ea tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:40.243082 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-13c3a915-5928-403f-aaf6-7d2950b2c4ea tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:40.243883 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-13c3a915-5928-403f-aaf6-7d2950b2c4ea tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:40.244309 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-13c3a915-5928-403f-aaf6-7d2950b2c4ea tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:40.383554 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-13c3a915-5928-403f-aaf6-7d2950b2c4ea tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:40.391367 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-13c3a915-5928-403f-aaf6-7d2950b2c4ea tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1318 microversion: 2.1 time: 0.159338 Oct 28 12:14:40.391928 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 150/324] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:40 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:40.678277 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d0515e92-2ceb-4812-bd33-181c7b24cb73 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:40.678996 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d0515e92-2ceb-4812-bd33-181c7b24cb73 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:40.686964 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d0515e92-2ceb-4812-bd33-181c7b24cb73 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:40.687416 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d0515e92-2ceb-4812-bd33-181c7b24cb73 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:40.688198 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d0515e92-2ceb-4812-bd33-181c7b24cb73 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:40.688634 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d0515e92-2ceb-4812-bd33-181c7b24cb73 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:40.899693 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d0515e92-2ceb-4812-bd33-181c7b24cb73 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:40.907389 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d0515e92-2ceb-4812-bd33-181c7b24cb73 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.233048 Oct 28 12:14:40.909360 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 175/325] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:40 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:41.213134 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-520f8fc0-bc91-4dae-b8ae-a8d3817fac72 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:41.214548 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-520f8fc0-bc91-4dae-b8ae-a8d3817fac72 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:41.220514 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-520f8fc0-bc91-4dae-b8ae-a8d3817fac72 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:41.220970 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-520f8fc0-bc91-4dae-b8ae-a8d3817fac72 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:41.221761 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-520f8fc0-bc91-4dae-b8ae-a8d3817fac72 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:41.222232 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-520f8fc0-bc91-4dae-b8ae-a8d3817fac72 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:41.407742 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-576b45f3-2de1-45c4-b0c7-0e7fca2c50fe tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:41.408341 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-576b45f3-2de1-45c4-b0c7-0e7fca2c50fe tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:41.414393 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-576b45f3-2de1-45c4-b0c7-0e7fca2c50fe tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:41.414828 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-576b45f3-2de1-45c4-b0c7-0e7fca2c50fe tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:41.415646 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-576b45f3-2de1-45c4-b0c7-0e7fca2c50fe tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:41.416065 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-576b45f3-2de1-45c4-b0c7-0e7fca2c50fe tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:41.488115 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-520f8fc0-bc91-4dae-b8ae-a8d3817fac72 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.278393 Oct 28 12:14:41.488926 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 151/326] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:41 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:14:41.549285 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-576b45f3-2de1-45c4-b0c7-0e7fca2c50fe tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:41.556635 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-576b45f3-2de1-45c4-b0c7-0e7fca2c50fe tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1508 microversion: 2.1 time: 0.152575 Oct 28 12:14:41.557188 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 176/327] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:41 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:41.575691 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-54354012-5cc3-4a91-8782-17026763290b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3dc57d1-1afe-4585-8ad6-3aa8e7c89dbd"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:41.576809 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-54354012-5cc3-4a91-8782-17026763290b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:41.583648 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54354012-5cc3-4a91-8782-17026763290b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:41.584155 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54354012-5cc3-4a91-8782-17026763290b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:41.584909 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54354012-5cc3-4a91-8782-17026763290b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:41.585328 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54354012-5cc3-4a91-8782-17026763290b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:41.662862 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-54354012-5cc3-4a91-8782-17026763290b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] HTTP exception thrown: Invalid volume: volume f3dc57d1-1afe-4585-8ad6-3aa8e7c89dbd is already attached to instances: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010 Oct 28 12:14:41.663483 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-54354012-5cc3-4a91-8782-17026763290b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Returning 400 to user: Invalid volume: volume f3dc57d1-1afe-4585-8ad6-3aa8e7c89dbd is already attached to instances: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010 {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:14:41.664357 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-54354012-5cc3-4a91-8782-17026763290b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "POST /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093305 Oct 28 12:14:41.664901 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 152/328] 10.222.0.37 () {60 vars in 1322 bytes} [Thu Oct 28 12:14:41 2021] POST /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 12:14:41.724660 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-32b401b1-ab9f-40a7-9893-c40c318be1ef tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:41.725154 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-32b401b1-ab9f-40a7-9893-c40c318be1ef tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:41.731309 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-32b401b1-ab9f-40a7-9893-c40c318be1ef tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:41.731755 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-32b401b1-ab9f-40a7-9893-c40c318be1ef tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:41.732515 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-32b401b1-ab9f-40a7-9893-c40c318be1ef tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:41.732943 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-32b401b1-ab9f-40a7-9893-c40c318be1ef tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:41.856346 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-32b401b1-ab9f-40a7-9893-c40c318be1ef tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lazy-loading 'services' on Instance uuid 0e8e6f3a-3f05-49d7-b1d4-b714a4382010 {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:14:41.924366 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-19e801c2-8398-4fe1-b338-2e702c3c6d5d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:41.924973 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-19e801c2-8398-4fe1-b338-2e702c3c6d5d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:41.932952 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-19e801c2-8398-4fe1-b338-2e702c3c6d5d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:41.933400 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-19e801c2-8398-4fe1-b338-2e702c3c6d5d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:41.934175 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-19e801c2-8398-4fe1-b338-2e702c3c6d5d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:41.934812 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-19e801c2-8398-4fe1-b338-2e702c3c6d5d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:41.976061 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-32b401b1-ab9f-40a7-9893-c40c318be1ef tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "DELETE /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments/f3dc57d1-1afe-4585-8ad6-3aa8e7c89dbd" status: 202 len: 0 microversion: 2.1 time: 0.254881 Oct 28 12:14:41.981630 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 177/329] 10.222.0.37 () {58 vars in 1415 bytes} [Thu Oct 28 12:14:41 2021] DELETE /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments/f3dc57d1-1afe-4585-8ad6-3aa8e7c89dbd => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:14:41.988916 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1adae3da-4681-4c54-bc62-d8ce1c555a94 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:41.990054 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1adae3da-4681-4c54-bc62-d8ce1c555a94 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:42.000491 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1adae3da-4681-4c54-bc62-d8ce1c555a94 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:42.000491 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1adae3da-4681-4c54-bc62-d8ce1c555a94 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:42.002953 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1adae3da-4681-4c54-bc62-d8ce1c555a94 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:42.003407 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1adae3da-4681-4c54-bc62-d8ce1c555a94 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:42.041786 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1adae3da-4681-4c54-bc62-d8ce1c555a94 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056357 Oct 28 12:14:42.047411 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 178/330] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:14:41 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:14:42.074517 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-19e801c2-8398-4fe1-b338-2e702c3c6d5d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:42.085810 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-19e801c2-8398-4fe1-b338-2e702c3c6d5d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.163615 Oct 28 12:14:42.087053 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 153/331] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:41 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:42.500421 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e7215bc5-cc30-4b6a-9706-379d6aa2b0de tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:42.501321 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e7215bc5-cc30-4b6a-9706-379d6aa2b0de tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:42.507615 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7215bc5-cc30-4b6a-9706-379d6aa2b0de tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:42.508060 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7215bc5-cc30-4b6a-9706-379d6aa2b0de tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:42.508822 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7215bc5-cc30-4b6a-9706-379d6aa2b0de tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:42.509256 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7215bc5-cc30-4b6a-9706-379d6aa2b0de tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:42.624957 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e7215bc5-cc30-4b6a-9706-379d6aa2b0de tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.127915 Oct 28 12:14:42.625781 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 179/332] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:42 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:14:43.054148 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-081e8b5e-14c5-415a-ad39-cb031880dc08 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:43.055131 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-081e8b5e-14c5-415a-ad39-cb031880dc08 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:43.062057 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-081e8b5e-14c5-415a-ad39-cb031880dc08 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:43.062502 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-081e8b5e-14c5-415a-ad39-cb031880dc08 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:43.063304 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-081e8b5e-14c5-415a-ad39-cb031880dc08 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:43.063734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-081e8b5e-14c5-415a-ad39-cb031880dc08 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:43.091547 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-081e8b5e-14c5-415a-ad39-cb031880dc08 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041122 Oct 28 12:14:43.092101 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 154/333] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:14:43 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:14:43.102539 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c66e5acd-992c-4b2c-a55c-0fd3b03b6f9a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:43.103253 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c66e5acd-992c-4b2c-a55c-0fd3b03b6f9a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:43.110393 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c66e5acd-992c-4b2c-a55c-0fd3b03b6f9a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:43.110859 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c66e5acd-992c-4b2c-a55c-0fd3b03b6f9a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:43.111612 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c66e5acd-992c-4b2c-a55c-0fd3b03b6f9a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:43.112037 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c66e5acd-992c-4b2c-a55c-0fd3b03b6f9a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:43.238322 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c66e5acd-992c-4b2c-a55c-0fd3b03b6f9a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:43.246230 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c66e5acd-992c-4b2c-a55c-0fd3b03b6f9a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.147628 Oct 28 12:14:43.246812 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 180/334] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:43 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:43.636261 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-06b1329c-290e-40ce-889d-e5eae038a1c4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:43.637160 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-06b1329c-290e-40ce-889d-e5eae038a1c4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:43.643350 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-06b1329c-290e-40ce-889d-e5eae038a1c4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:43.643785 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-06b1329c-290e-40ce-889d-e5eae038a1c4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:43.644539 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-06b1329c-290e-40ce-889d-e5eae038a1c4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:43.644959 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-06b1329c-290e-40ce-889d-e5eae038a1c4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:44.048540 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-06b1329c-290e-40ce-889d-e5eae038a1c4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.416255 Oct 28 12:14:44.049416 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 155/335] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:43 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:14:44.102797 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ad3e404a-b5de-4952-a127-81008af1fd93 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:44.103703 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ad3e404a-b5de-4952-a127-81008af1fd93 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:44.110524 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ad3e404a-b5de-4952-a127-81008af1fd93 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:44.111036 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ad3e404a-b5de-4952-a127-81008af1fd93 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:44.111779 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ad3e404a-b5de-4952-a127-81008af1fd93 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:44.112210 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ad3e404a-b5de-4952-a127-81008af1fd93 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:44.142906 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ad3e404a-b5de-4952-a127-81008af1fd93 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043832 Oct 28 12:14:44.143453 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 181/336] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:14:44 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:14:44.263145 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f289be9a-9b53-4fa8-8fdd-8e693b847104 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:44.263819 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f289be9a-9b53-4fa8-8fdd-8e693b847104 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:44.270433 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f289be9a-9b53-4fa8-8fdd-8e693b847104 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:44.270894 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f289be9a-9b53-4fa8-8fdd-8e693b847104 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:44.271641 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f289be9a-9b53-4fa8-8fdd-8e693b847104 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:44.272062 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f289be9a-9b53-4fa8-8fdd-8e693b847104 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:44.391558 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f289be9a-9b53-4fa8-8fdd-8e693b847104 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:44.398671 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f289be9a-9b53-4fa8-8fdd-8e693b847104 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.139367 Oct 28 12:14:44.399431 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 156/337] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:44 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:45.060667 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a244f01c-0f62-46bb-8d45-0b3f449af149 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:45.061484 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a244f01c-0f62-46bb-8d45-0b3f449af149 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:45.067727 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a244f01c-0f62-46bb-8d45-0b3f449af149 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:45.068230 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a244f01c-0f62-46bb-8d45-0b3f449af149 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:45.068995 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a244f01c-0f62-46bb-8d45-0b3f449af149 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:45.069427 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a244f01c-0f62-46bb-8d45-0b3f449af149 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:45.153212 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-adc1f87d-68f5-4ce8-a047-352424434d76 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:45.154097 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-adc1f87d-68f5-4ce8-a047-352424434d76 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:45.160330 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-adc1f87d-68f5-4ce8-a047-352424434d76 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:45.160774 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-adc1f87d-68f5-4ce8-a047-352424434d76 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:45.161532 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-adc1f87d-68f5-4ce8-a047-352424434d76 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:45.161968 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-adc1f87d-68f5-4ce8-a047-352424434d76 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:45.190479 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-adc1f87d-68f5-4ce8-a047-352424434d76 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041025 Oct 28 12:14:45.191052 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 157/338] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:14:45 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:14:45.415538 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8b841fcb-5143-41f7-ba12-8f45c95ac784 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:45.416173 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8b841fcb-5143-41f7-ba12-8f45c95ac784 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:45.422815 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b841fcb-5143-41f7-ba12-8f45c95ac784 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:45.423280 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b841fcb-5143-41f7-ba12-8f45c95ac784 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:45.424039 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b841fcb-5143-41f7-ba12-8f45c95ac784 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:45.424468 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b841fcb-5143-41f7-ba12-8f45c95ac784 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:45.544713 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8b841fcb-5143-41f7-ba12-8f45c95ac784 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:45.552202 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8b841fcb-5143-41f7-ba12-8f45c95ac784 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.140250 Oct 28 12:14:45.552758 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 158/339] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:45 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:46.201381 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2b1ba9cc-367f-4bf3-88d1-c2f1c2d590fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:46.202281 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2b1ba9cc-367f-4bf3-88d1-c2f1c2d590fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:46.208542 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2b1ba9cc-367f-4bf3-88d1-c2f1c2d590fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:46.208973 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2b1ba9cc-367f-4bf3-88d1-c2f1c2d590fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:46.209717 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2b1ba9cc-367f-4bf3-88d1-c2f1c2d590fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:46.210139 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2b1ba9cc-367f-4bf3-88d1-c2f1c2d590fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:46.238192 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2b1ba9cc-367f-4bf3-88d1-c2f1c2d590fd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040514 Oct 28 12:14:46.238742 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 159/340] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:14:46 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:14:46.569383 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5042aa90-7c7e-4056-b711-153ee71b2086 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:46.569979 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5042aa90-7c7e-4056-b711-153ee71b2086 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:46.576135 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5042aa90-7c7e-4056-b711-153ee71b2086 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:46.577189 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5042aa90-7c7e-4056-b711-153ee71b2086 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:46.577959 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5042aa90-7c7e-4056-b711-153ee71b2086 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:46.578382 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5042aa90-7c7e-4056-b711-153ee71b2086 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:46.699190 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5042aa90-7c7e-4056-b711-153ee71b2086 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:46.706193 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5042aa90-7c7e-4056-b711-153ee71b2086 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.140792 Oct 28 12:14:46.706764 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 160/341] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:46 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:47.249403 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-433c4328-b6e0-4753-88e1-4e0e30072de1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:47.250489 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-433c4328-b6e0-4753-88e1-4e0e30072de1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:47.256786 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-433c4328-b6e0-4753-88e1-4e0e30072de1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:47.257208 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-433c4328-b6e0-4753-88e1-4e0e30072de1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:47.257972 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-433c4328-b6e0-4753-88e1-4e0e30072de1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:47.258396 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-433c4328-b6e0-4753-88e1-4e0e30072de1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:47.288062 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-433c4328-b6e0-4753-88e1-4e0e30072de1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042465 Oct 28 12:14:47.288599 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 161/342] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:14:47 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:14:47.722662 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-826a4560-768a-4961-9d34-b1c34e5f2eb2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:47.723285 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-826a4560-768a-4961-9d34-b1c34e5f2eb2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:47.729455 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-826a4560-768a-4961-9d34-b1c34e5f2eb2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:47.729904 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-826a4560-768a-4961-9d34-b1c34e5f2eb2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:47.730701 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-826a4560-768a-4961-9d34-b1c34e5f2eb2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:47.731152 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-826a4560-768a-4961-9d34-b1c34e5f2eb2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:47.943494 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a244f01c-0f62-46bb-8d45-0b3f449af149 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 2.886780 Oct 28 12:14:47.944317 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 182/343] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:45 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 2889 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:14:47.994792 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-826a4560-768a-4961-9d34-b1c34e5f2eb2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:48.003784 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-826a4560-768a-4961-9d34-b1c34e5f2eb2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.284654 Oct 28 12:14:48.004350 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 162/344] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:47 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:48.300883 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6fc08c64-a540-418a-a285-20873b20c809 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:48.301855 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6fc08c64-a540-418a-a285-20873b20c809 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:48.309146 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6fc08c64-a540-418a-a285-20873b20c809 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:48.309583 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6fc08c64-a540-418a-a285-20873b20c809 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:48.310330 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6fc08c64-a540-418a-a285-20873b20c809 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:48.310776 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6fc08c64-a540-418a-a285-20873b20c809 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:48.338964 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6fc08c64-a540-418a-a285-20873b20c809 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042484 Oct 28 12:14:48.339534 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 183/345] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:14:48 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:14:48.955359 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-66894c31-af1a-48bf-b932-58b42e124aba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:48.956249 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-66894c31-af1a-48bf-b932-58b42e124aba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:48.962313 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66894c31-af1a-48bf-b932-58b42e124aba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:48.962784 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66894c31-af1a-48bf-b932-58b42e124aba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:48.963536 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66894c31-af1a-48bf-b932-58b42e124aba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:48.963951 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66894c31-af1a-48bf-b932-58b42e124aba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:49.021425 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-caa30d7c-f1fc-45ad-ba5a-85cd6554cb75 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:49.022065 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-caa30d7c-f1fc-45ad-ba5a-85cd6554cb75 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:49.029186 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-caa30d7c-f1fc-45ad-ba5a-85cd6554cb75 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:49.029629 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-caa30d7c-f1fc-45ad-ba5a-85cd6554cb75 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:49.029835 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-66894c31-af1a-48bf-b932-58b42e124aba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.078017 Oct 28 12:14:49.030399 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-caa30d7c-f1fc-45ad-ba5a-85cd6554cb75 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:49.030546 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 163/346] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:48 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:14:49.030868 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-caa30d7c-f1fc-45ad-ba5a-85cd6554cb75 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:49.152320 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-caa30d7c-f1fc-45ad-ba5a-85cd6554cb75 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:49.159992 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-caa30d7c-f1fc-45ad-ba5a-85cd6554cb75 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.142211 Oct 28 12:14:49.160554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 184/347] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:49 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:49.349932 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c4ef8a12-24ed-4845-9532-fcc6a96dbede tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:49.350968 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c4ef8a12-24ed-4845-9532-fcc6a96dbede tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:49.358302 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c4ef8a12-24ed-4845-9532-fcc6a96dbede tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:49.358790 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c4ef8a12-24ed-4845-9532-fcc6a96dbede tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:49.359552 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c4ef8a12-24ed-4845-9532-fcc6a96dbede tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:49.359981 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c4ef8a12-24ed-4845-9532-fcc6a96dbede tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:49.389162 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c4ef8a12-24ed-4845-9532-fcc6a96dbede tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043513 Oct 28 12:14:49.389706 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 164/348] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:14:49 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:14:50.041459 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-87320f59-c83b-42ca-83d2-315888b3c1e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:50.042409 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-87320f59-c83b-42ca-83d2-315888b3c1e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:50.051242 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-87320f59-c83b-42ca-83d2-315888b3c1e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:50.051679 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-87320f59-c83b-42ca-83d2-315888b3c1e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:50.052455 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-87320f59-c83b-42ca-83d2-315888b3c1e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:50.053189 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-87320f59-c83b-42ca-83d2-315888b3c1e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:50.165312 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-87320f59-c83b-42ca-83d2-315888b3c1e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.127460 Oct 28 12:14:50.166420 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 185/349] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:50 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:14:50.177260 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-44f0a089-51e6-49fe-950a-cb2a0087ee35 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:50.177901 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-44f0a089-51e6-49fe-950a-cb2a0087ee35 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:50.184531 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44f0a089-51e6-49fe-950a-cb2a0087ee35 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:50.184964 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44f0a089-51e6-49fe-950a-cb2a0087ee35 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:50.185719 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44f0a089-51e6-49fe-950a-cb2a0087ee35 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:50.186141 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44f0a089-51e6-49fe-950a-cb2a0087ee35 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:50.309998 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-44f0a089-51e6-49fe-950a-cb2a0087ee35 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:50.317266 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-44f0a089-51e6-49fe-950a-cb2a0087ee35 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.143664 Oct 28 12:14:50.317821 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 165/350] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:50 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:50.400725 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-aeb45db3-72cd-455b-81f8-cc14229e46f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:50.401689 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-aeb45db3-72cd-455b-81f8-cc14229e46f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:50.408493 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aeb45db3-72cd-455b-81f8-cc14229e46f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:50.408933 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aeb45db3-72cd-455b-81f8-cc14229e46f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:50.409698 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aeb45db3-72cd-455b-81f8-cc14229e46f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:50.410121 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aeb45db3-72cd-455b-81f8-cc14229e46f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:50.439648 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-aeb45db3-72cd-455b-81f8-cc14229e46f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043123 Oct 28 12:14:50.440189 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 186/351] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:14:50 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 12:14:50.602822 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-43ebdb88-a589-4848-b57f-c7e53c841554 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-689722708", "imageRef": "4385a199-a3e9-4c11-b580-60e7a24d0e97", "flavorRef": "452", "networks": [{"uuid": "6473d7e8-f419-4ba9-aecd-de2094cc6dd8"}]}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:50.655892 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-43ebdb88-a589-4848-b57f-c7e53c841554 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] validate_networks() for [('6473d7e8-f419-4ba9-aecd-de2094cc6dd8', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:14:51.032826 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-43ebdb88-a589-4848-b57f-c7e53c841554 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:14:51.033270 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-43ebdb88-a589-4848-b57f-c7e53c841554 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:14:51.033737 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-43ebdb88-a589-4848-b57f-c7e53c841554 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:14:51.034134 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-43ebdb88-a589-4848-b57f-c7e53c841554 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:14:51.034532 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-43ebdb88-a589-4848-b57f-c7e53c841554 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:14:51.043014 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-43ebdb88-a589-4848-b57f-c7e53c841554 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:51.043452 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-43ebdb88-a589-4848-b57f-c7e53c841554 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:51.044256 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-43ebdb88-a589-4848-b57f-c7e53c841554 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:51.044750 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-43ebdb88-a589-4848-b57f-c7e53c841554 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:51.062445 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-43ebdb88-a589-4848-b57f-c7e53c841554 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Getting quotas for project f032353009b64d738b6c00574846cb51. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:14:51.066520 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-43ebdb88-a589-4848-b57f-c7e53c841554 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Getting quotas for user 27f6b74ea1274a9bba153118ccf63571 and project f032353009b64d738b6c00574846cb51. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:14:51.078397 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-43ebdb88-a589-4848-b57f-c7e53c841554 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:14:51.080855 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-43ebdb88-a589-4848-b57f-c7e53c841554 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4385a199-a3e9-4c11-b580-60e7a24d0e97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:14:51.165744 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-43ebdb88-a589-4848-b57f-c7e53c841554 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566337 Oct 28 12:14:51.168000 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 166/352] 10.222.0.37 () {60 vars in 1146 bytes} [Thu Oct 28 12:14:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 12:14:51.176543 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e293c30c-f8a3-41de-9f50-0b7a62accdeb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:51.178205 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e293c30c-f8a3-41de-9f50-0b7a62accdeb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:51.181905 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-46c6fb6d-bf62-4557-8647-2cb193e4b4d0 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:51.186819 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e293c30c-f8a3-41de-9f50-0b7a62accdeb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:51.187651 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e293c30c-f8a3-41de-9f50-0b7a62accdeb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:51.189069 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e293c30c-f8a3-41de-9f50-0b7a62accdeb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:51.189907 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e293c30c-f8a3-41de-9f50-0b7a62accdeb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:51.199409 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-46c6fb6d-bf62-4557-8647-2cb193e4b4d0 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:51.315777 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-46c6fb6d-bf62-4557-8647-2cb193e4b4d0 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:51.320122 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e293c30c-f8a3-41de-9f50-0b7a62accdeb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.146963 Oct 28 12:14:51.323353 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 187/353] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:51 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:14:51.329675 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-46c6fb6d-bf62-4557-8647-2cb193e4b4d0 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1217 microversion: 2.1 time: 0.153286 Oct 28 12:14:51.330660 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 167/354] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:51 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:51.337738 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2314eea1-4c40-47a1-bb4f-9ed031572817 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:51.338438 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2314eea1-4c40-47a1-bb4f-9ed031572817 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:51.351117 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2314eea1-4c40-47a1-bb4f-9ed031572817 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:51.351569 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2314eea1-4c40-47a1-bb4f-9ed031572817 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:51.352547 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2314eea1-4c40-47a1-bb4f-9ed031572817 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:51.353131 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2314eea1-4c40-47a1-bb4f-9ed031572817 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:51.593941 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2314eea1-4c40-47a1-bb4f-9ed031572817 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:51.601742 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2314eea1-4c40-47a1-bb4f-9ed031572817 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.270236 Oct 28 12:14:51.605533 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 188/355] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:51 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:52.332622 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-89792d22-da0f-4f5b-97ab-78205a06376e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:52.333587 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-89792d22-da0f-4f5b-97ab-78205a06376e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:52.340977 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-89792d22-da0f-4f5b-97ab-78205a06376e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:52.341424 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-89792d22-da0f-4f5b-97ab-78205a06376e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:52.342190 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-89792d22-da0f-4f5b-97ab-78205a06376e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:52.342808 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-89792d22-da0f-4f5b-97ab-78205a06376e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:52.348319 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d9556b53-9ed2-4e7b-ab8e-44a009228a20 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:52.348971 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d9556b53-9ed2-4e7b-ab8e-44a009228a20 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:52.358931 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d9556b53-9ed2-4e7b-ab8e-44a009228a20 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:52.359381 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d9556b53-9ed2-4e7b-ab8e-44a009228a20 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:52.360181 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d9556b53-9ed2-4e7b-ab8e-44a009228a20 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:52.360614 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d9556b53-9ed2-4e7b-ab8e-44a009228a20 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:52.438664 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d9556b53-9ed2-4e7b-ab8e-44a009228a20 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:52.447462 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d9556b53-9ed2-4e7b-ab8e-44a009228a20 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1213 microversion: 2.1 time: 0.102473 Oct 28 12:14:52.449847 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 189/356] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:52 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:52.620693 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b075e74a-b386-424f-8f15-3867ff5672e6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:52.621460 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b075e74a-b386-424f-8f15-3867ff5672e6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:52.627635 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b075e74a-b386-424f-8f15-3867ff5672e6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:52.628154 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b075e74a-b386-424f-8f15-3867ff5672e6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:52.628988 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b075e74a-b386-424f-8f15-3867ff5672e6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:52.629493 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b075e74a-b386-424f-8f15-3867ff5672e6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:52.757286 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b075e74a-b386-424f-8f15-3867ff5672e6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:52.765055 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b075e74a-b386-424f-8f15-3867ff5672e6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.148048 Oct 28 12:14:52.765626 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 190/357] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:52 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:53.464340 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7a8488dd-1c69-4793-b614-10a0cb988012 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:53.465050 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7a8488dd-1c69-4793-b614-10a0cb988012 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:53.471652 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7a8488dd-1c69-4793-b614-10a0cb988012 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:53.472098 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7a8488dd-1c69-4793-b614-10a0cb988012 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:53.472886 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7a8488dd-1c69-4793-b614-10a0cb988012 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:53.473318 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7a8488dd-1c69-4793-b614-10a0cb988012 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:53.534329 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7a8488dd-1c69-4793-b614-10a0cb988012 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:53.541648 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7a8488dd-1c69-4793-b614-10a0cb988012 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1213 microversion: 2.1 time: 0.081055 Oct 28 12:14:53.542218 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 191/358] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:53 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:53.781373 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-31a42214-9457-4871-9467-c97996f2ea5d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:53.782032 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-31a42214-9457-4871-9467-c97996f2ea5d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:53.787655 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-31a42214-9457-4871-9467-c97996f2ea5d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:53.788102 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-31a42214-9457-4871-9467-c97996f2ea5d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:53.788864 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-31a42214-9457-4871-9467-c97996f2ea5d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:53.789291 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-31a42214-9457-4871-9467-c97996f2ea5d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:53.941074 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-31a42214-9457-4871-9467-c97996f2ea5d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:53.951174 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-31a42214-9457-4871-9467-c97996f2ea5d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.173427 Oct 28 12:14:53.960585 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 192/359] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:53 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:54.559306 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6fca60fa-2429-47df-bfbb-a1b855bfa473 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:54.559906 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6fca60fa-2429-47df-bfbb-a1b855bfa473 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:54.566269 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6fca60fa-2429-47df-bfbb-a1b855bfa473 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:54.566736 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6fca60fa-2429-47df-bfbb-a1b855bfa473 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:54.567574 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6fca60fa-2429-47df-bfbb-a1b855bfa473 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:54.567990 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6fca60fa-2429-47df-bfbb-a1b855bfa473 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:54.632945 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6fca60fa-2429-47df-bfbb-a1b855bfa473 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:54.640468 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6fca60fa-2429-47df-bfbb-a1b855bfa473 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1213 microversion: 2.1 time: 0.085210 Oct 28 12:14:54.641038 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 193/360] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:54 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:54.968200 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7e90b728-f8ca-4281-b4fd-6595d2fd8917 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:54.968935 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7e90b728-f8ca-4281-b4fd-6595d2fd8917 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:54.974723 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7e90b728-f8ca-4281-b4fd-6595d2fd8917 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:54.975170 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7e90b728-f8ca-4281-b4fd-6595d2fd8917 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:54.975925 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7e90b728-f8ca-4281-b4fd-6595d2fd8917 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:54.976352 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7e90b728-f8ca-4281-b4fd-6595d2fd8917 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:55.099911 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7e90b728-f8ca-4281-b4fd-6595d2fd8917 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:55.107045 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7e90b728-f8ca-4281-b4fd-6595d2fd8917 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.143034 Oct 28 12:14:55.107615 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 194/361] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:54 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:55.657921 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2913e542-72e3-488e-953f-2a7cd2b1e5f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:55.659331 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2913e542-72e3-488e-953f-2a7cd2b1e5f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:55.666867 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2913e542-72e3-488e-953f-2a7cd2b1e5f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:55.667972 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2913e542-72e3-488e-953f-2a7cd2b1e5f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:55.669082 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2913e542-72e3-488e-953f-2a7cd2b1e5f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:55.669789 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2913e542-72e3-488e-953f-2a7cd2b1e5f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:55.732915 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2913e542-72e3-488e-953f-2a7cd2b1e5f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:55.740027 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2913e542-72e3-488e-953f-2a7cd2b1e5f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1213 microversion: 2.1 time: 0.086252 Oct 28 12:14:55.740576 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 195/362] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:55 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:56.124089 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d0adef74-d400-4b6f-83e8-dbb593570c46 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:56.124612 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d0adef74-d400-4b6f-83e8-dbb593570c46 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:56.130370 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d0adef74-d400-4b6f-83e8-dbb593570c46 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:56.130843 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d0adef74-d400-4b6f-83e8-dbb593570c46 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:56.131597 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d0adef74-d400-4b6f-83e8-dbb593570c46 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:56.132023 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d0adef74-d400-4b6f-83e8-dbb593570c46 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:56.253397 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d0adef74-d400-4b6f-83e8-dbb593570c46 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:56.260435 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d0adef74-d400-4b6f-83e8-dbb593570c46 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.140529 Oct 28 12:14:56.261589 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 196/363] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:56 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:56.660088 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-89792d22-da0f-4f5b-97ab-78205a06376e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 4.330948 Oct 28 12:14:56.660729 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 168/364] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:52 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 4332 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:14:56.756432 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6c99f970-3791-40f5-bfd8-0aaaff00ccfd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:56.756938 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6c99f970-3791-40f5-bfd8-0aaaff00ccfd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:56.763204 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c99f970-3791-40f5-bfd8-0aaaff00ccfd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:56.763647 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c99f970-3791-40f5-bfd8-0aaaff00ccfd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:56.764413 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c99f970-3791-40f5-bfd8-0aaaff00ccfd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:56.764884 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c99f970-3791-40f5-bfd8-0aaaff00ccfd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:56.830456 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6c99f970-3791-40f5-bfd8-0aaaff00ccfd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:56.837690 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6c99f970-3791-40f5-bfd8-0aaaff00ccfd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1213 microversion: 2.1 time: 0.084994 Oct 28 12:14:56.838246 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 197/365] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:56 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:57.277791 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b2a3898d-fb63-48c6-a502-319c181b5ac6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:57.278398 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b2a3898d-fb63-48c6-a502-319c181b5ac6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:57.285240 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2a3898d-fb63-48c6-a502-319c181b5ac6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:57.285686 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2a3898d-fb63-48c6-a502-319c181b5ac6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:57.286454 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2a3898d-fb63-48c6-a502-319c181b5ac6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:57.286922 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2a3898d-fb63-48c6-a502-319c181b5ac6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:57.427174 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b2a3898d-fb63-48c6-a502-319c181b5ac6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:57.435693 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b2a3898d-fb63-48c6-a502-319c181b5ac6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.162004 Oct 28 12:14:57.436256 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 169/366] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:57 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:57.672663 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-423e6469-184b-48e2-bc8d-32f0135c1f5c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:57.673626 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-423e6469-184b-48e2-bc8d-32f0135c1f5c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:57.679458 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-423e6469-184b-48e2-bc8d-32f0135c1f5c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:57.679907 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-423e6469-184b-48e2-bc8d-32f0135c1f5c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:57.680668 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-423e6469-184b-48e2-bc8d-32f0135c1f5c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:57.681099 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-423e6469-184b-48e2-bc8d-32f0135c1f5c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:57.855306 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-69aeaa97-3c13-4c65-ae00-9f1090c80704 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:57.855916 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-69aeaa97-3c13-4c65-ae00-9f1090c80704 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:57.862037 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69aeaa97-3c13-4c65-ae00-9f1090c80704 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:57.862477 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69aeaa97-3c13-4c65-ae00-9f1090c80704 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:57.863263 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69aeaa97-3c13-4c65-ae00-9f1090c80704 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:57.863695 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69aeaa97-3c13-4c65-ae00-9f1090c80704 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:57.922575 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-69aeaa97-3c13-4c65-ae00-9f1090c80704 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:57.929652 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-69aeaa97-3c13-4c65-ae00-9f1090c80704 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1213 microversion: 2.1 time: 0.078749 Oct 28 12:14:57.930216 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 170/367] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:57 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:14:58.235789 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-423e6469-184b-48e2-bc8d-32f0135c1f5c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.566881 Oct 28 12:14:58.236768 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 198/368] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:57 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:14:58.453293 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e48168c1-6395-4326-b8f5-7aae8c7cdcb6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:58.453921 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e48168c1-6395-4326-b8f5-7aae8c7cdcb6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:58.460113 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e48168c1-6395-4326-b8f5-7aae8c7cdcb6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:58.460553 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e48168c1-6395-4326-b8f5-7aae8c7cdcb6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:58.461315 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e48168c1-6395-4326-b8f5-7aae8c7cdcb6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:58.461741 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e48168c1-6395-4326-b8f5-7aae8c7cdcb6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:58.584454 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e48168c1-6395-4326-b8f5-7aae8c7cdcb6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:58.591594 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e48168c1-6395-4326-b8f5-7aae8c7cdcb6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.142048 Oct 28 12:14:58.592149 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 171/369] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:58 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:58.945677 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2c4bfb6e-b825-4f3f-8b2b-597a8eb2f642 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:58.946373 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2c4bfb6e-b825-4f3f-8b2b-597a8eb2f642 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:58.954095 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c4bfb6e-b825-4f3f-8b2b-597a8eb2f642 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:58.954546 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c4bfb6e-b825-4f3f-8b2b-597a8eb2f642 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:58.955348 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c4bfb6e-b825-4f3f-8b2b-597a8eb2f642 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:58.956039 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c4bfb6e-b825-4f3f-8b2b-597a8eb2f642 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:59.059769 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2c4bfb6e-b825-4f3f-8b2b-597a8eb2f642 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:59.066888 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2c4bfb6e-b825-4f3f-8b2b-597a8eb2f642 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1275 microversion: 2.1 time: 0.125289 Oct 28 12:14:59.067525 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 199/370] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:58 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1275 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:14:59.247804 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b1c545c9-dd8a-46d2-90c8-7476d0cf7ff4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:14:59.248829 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b1c545c9-dd8a-46d2-90c8-7476d0cf7ff4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:59.255286 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b1c545c9-dd8a-46d2-90c8-7476d0cf7ff4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:59.255730 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b1c545c9-dd8a-46d2-90c8-7476d0cf7ff4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:59.256495 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b1c545c9-dd8a-46d2-90c8-7476d0cf7ff4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:59.256922 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b1c545c9-dd8a-46d2-90c8-7476d0cf7ff4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:59.324067 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b1c545c9-dd8a-46d2-90c8-7476d0cf7ff4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.079776 Oct 28 12:14:59.324708 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 172/371] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:14:59 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:14:59.608230 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-34278e52-7496-4a45-8fc1-f6693e5499a5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:14:59.608885 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-34278e52-7496-4a45-8fc1-f6693e5499a5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:14:59.616122 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-34278e52-7496-4a45-8fc1-f6693e5499a5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:59.616829 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-34278e52-7496-4a45-8fc1-f6693e5499a5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:59.617824 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-34278e52-7496-4a45-8fc1-f6693e5499a5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:14:59.618446 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-34278e52-7496-4a45-8fc1-f6693e5499a5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:14:59.856549 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-34278e52-7496-4a45-8fc1-f6693e5499a5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:14:59.863643 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-34278e52-7496-4a45-8fc1-f6693e5499a5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.259135 Oct 28 12:14:59.864365 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 200/372] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:14:59 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:00.084133 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-59f1506f-9fbb-4d4f-82aa-250a6a50deaa tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:00.084985 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-59f1506f-9fbb-4d4f-82aa-250a6a50deaa tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:00.091812 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59f1506f-9fbb-4d4f-82aa-250a6a50deaa tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:00.092260 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59f1506f-9fbb-4d4f-82aa-250a6a50deaa tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:00.093078 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59f1506f-9fbb-4d4f-82aa-250a6a50deaa tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:00.093507 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59f1506f-9fbb-4d4f-82aa-250a6a50deaa tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:00.221238 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-59f1506f-9fbb-4d4f-82aa-250a6a50deaa tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:00.230930 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-59f1506f-9fbb-4d4f-82aa-250a6a50deaa tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.150628 Oct 28 12:15:00.238274 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-9cb4ef57-bbdc-4b3b-93a7-d3920a482bb5 req-ca74dfa7-e4aa-4545-b9a2-cc17d9c86c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "948c9fed-b55d-4b55-9971-f4db721088aa", "tag": "1391e735-fffa-4d34-9821-38ee846f2984"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:00.240042 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:15:00.240042 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:15:00.240796 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 173/373] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:00 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:00.248843 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-9cb4ef57-bbdc-4b3b-93a7-d3920a482bb5 req-ca74dfa7-e4aa-4545-b9a2-cc17d9c86c80 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:00.249496 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-9cb4ef57-bbdc-4b3b-93a7-d3920a482bb5 req-ca74dfa7-e4aa-4545-b9a2-cc17d9c86c80 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:00.270995 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-9cb4ef57-bbdc-4b3b-93a7-d3920a482bb5 req-ca74dfa7-e4aa-4545-b9a2-cc17d9c86c80 service nova] Creating event network-changed:1391e735-fffa-4d34-9821-38ee846f2984 for instance 948c9fed-b55d-4b55-9971-f4db721088aa on hv-cinder-81571 Oct 28 12:15:00.275673 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-9cb4ef57-bbdc-4b3b-93a7-d3920a482bb5 req-ca74dfa7-e4aa-4545-b9a2-cc17d9c86c80 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040901 Oct 28 12:15:00.276258 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 201/374] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:15:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:15:00.335720 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ddeffbbc-87c6-4d04-85db-24a392653e6d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:00.336786 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ddeffbbc-87c6-4d04-85db-24a392653e6d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:00.342672 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ddeffbbc-87c6-4d04-85db-24a392653e6d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:00.343227 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ddeffbbc-87c6-4d04-85db-24a392653e6d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:00.344072 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ddeffbbc-87c6-4d04-85db-24a392653e6d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:00.344574 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ddeffbbc-87c6-4d04-85db-24a392653e6d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:00.758201 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ddeffbbc-87c6-4d04-85db-24a392653e6d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.425945 Oct 28 12:15:00.758911 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 174/375] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:00 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:15:00.881891 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6dce557a-8f54-46bc-98b6-fafd69d301dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:00.886404 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6dce557a-8f54-46bc-98b6-fafd69d301dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:00.892650 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6dce557a-8f54-46bc-98b6-fafd69d301dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:00.893114 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6dce557a-8f54-46bc-98b6-fafd69d301dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:00.894355 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6dce557a-8f54-46bc-98b6-fafd69d301dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:00.894809 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6dce557a-8f54-46bc-98b6-fafd69d301dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:01.086743 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6dce557a-8f54-46bc-98b6-fafd69d301dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:01.094645 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6dce557a-8f54-46bc-98b6-fafd69d301dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.217272 Oct 28 12:15:01.095260 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 202/376] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:00 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:01.249299 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1abcbf5d-85d5-4002-a5ef-4a77094e6087 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:01.250055 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1abcbf5d-85d5-4002-a5ef-4a77094e6087 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:01.256626 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1abcbf5d-85d5-4002-a5ef-4a77094e6087 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:01.257078 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1abcbf5d-85d5-4002-a5ef-4a77094e6087 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:01.257855 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1abcbf5d-85d5-4002-a5ef-4a77094e6087 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:01.258461 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1abcbf5d-85d5-4002-a5ef-4a77094e6087 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:01.405555 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1abcbf5d-85d5-4002-a5ef-4a77094e6087 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:01.413541 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1abcbf5d-85d5-4002-a5ef-4a77094e6087 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.168449 Oct 28 12:15:01.414107 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 175/377] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:01 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:01.769001 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7fd477e9-1aa0-4d20-9e69-ebb61eabd479 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:01.769943 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7fd477e9-1aa0-4d20-9e69-ebb61eabd479 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:01.775797 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7fd477e9-1aa0-4d20-9e69-ebb61eabd479 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:01.776244 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7fd477e9-1aa0-4d20-9e69-ebb61eabd479 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:01.777689 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7fd477e9-1aa0-4d20-9e69-ebb61eabd479 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:01.778123 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7fd477e9-1aa0-4d20-9e69-ebb61eabd479 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:01.943123 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7fd477e9-1aa0-4d20-9e69-ebb61eabd479 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.177557 Oct 28 12:15:01.943804 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 203/378] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:01 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:15:02.111538 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fba74fa7-b365-4bd7-b973-3a5c9837e240 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:02.112123 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fba74fa7-b365-4bd7-b973-3a5c9837e240 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:02.118505 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fba74fa7-b365-4bd7-b973-3a5c9837e240 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:02.118992 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fba74fa7-b365-4bd7-b973-3a5c9837e240 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:02.119797 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fba74fa7-b365-4bd7-b973-3a5c9837e240 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:02.121110 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fba74fa7-b365-4bd7-b973-3a5c9837e240 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:02.257227 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fba74fa7-b365-4bd7-b973-3a5c9837e240 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:02.265228 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fba74fa7-b365-4bd7-b973-3a5c9837e240 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.157682 Oct 28 12:15:02.265810 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 176/379] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:02 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:02.430783 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-82a0f140-3eb2-49fb-9e8e-cb6d07083aa7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:02.431539 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-82a0f140-3eb2-49fb-9e8e-cb6d07083aa7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:02.439038 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-82a0f140-3eb2-49fb-9e8e-cb6d07083aa7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:02.439486 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-82a0f140-3eb2-49fb-9e8e-cb6d07083aa7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:02.440259 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-82a0f140-3eb2-49fb-9e8e-cb6d07083aa7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:02.440686 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-82a0f140-3eb2-49fb-9e8e-cb6d07083aa7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:02.559088 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-82a0f140-3eb2-49fb-9e8e-cb6d07083aa7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:02.566203 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-82a0f140-3eb2-49fb-9e8e-cb6d07083aa7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.139544 Oct 28 12:15:02.566783 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 204/380] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:02 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:02.955693 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-aec79c6f-7c9a-464a-8087-99f0b74320d8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:02.956905 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-aec79c6f-7c9a-464a-8087-99f0b74320d8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:02.963090 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aec79c6f-7c9a-464a-8087-99f0b74320d8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:02.963534 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aec79c6f-7c9a-464a-8087-99f0b74320d8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:02.964345 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aec79c6f-7c9a-464a-8087-99f0b74320d8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:02.964775 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aec79c6f-7c9a-464a-8087-99f0b74320d8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:03.281889 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d2034300-9a0d-4c3a-8423-a5d0022adfd1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:03.282482 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d2034300-9a0d-4c3a-8423-a5d0022adfd1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:03.288599 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d2034300-9a0d-4c3a-8423-a5d0022adfd1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:03.289037 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d2034300-9a0d-4c3a-8423-a5d0022adfd1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:03.289786 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d2034300-9a0d-4c3a-8423-a5d0022adfd1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:03.290209 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d2034300-9a0d-4c3a-8423-a5d0022adfd1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:03.409132 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d2034300-9a0d-4c3a-8423-a5d0022adfd1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:03.417365 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d2034300-9a0d-4c3a-8423-a5d0022adfd1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.138667 Oct 28 12:15:03.418121 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 205/381] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:03 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:03.581947 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e610f55c-82fd-42b9-ac85-70bb26fff5ed tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:03.582548 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e610f55c-82fd-42b9-ac85-70bb26fff5ed tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:03.588318 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e610f55c-82fd-42b9-ac85-70bb26fff5ed tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:03.588759 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e610f55c-82fd-42b9-ac85-70bb26fff5ed tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:03.589623 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e610f55c-82fd-42b9-ac85-70bb26fff5ed tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:03.590066 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e610f55c-82fd-42b9-ac85-70bb26fff5ed tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:03.709107 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e610f55c-82fd-42b9-ac85-70bb26fff5ed tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:03.716258 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e610f55c-82fd-42b9-ac85-70bb26fff5ed tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.137881 Oct 28 12:15:03.716820 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 206/382] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:03 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:04.434226 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2ef18f58-8429-4e6d-afce-b3485fd14932 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:04.434849 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2ef18f58-8429-4e6d-afce-b3485fd14932 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:04.440647 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ef18f58-8429-4e6d-afce-b3485fd14932 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:04.441080 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ef18f58-8429-4e6d-afce-b3485fd14932 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:04.441837 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ef18f58-8429-4e6d-afce-b3485fd14932 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:04.442256 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2ef18f58-8429-4e6d-afce-b3485fd14932 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:04.561552 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2ef18f58-8429-4e6d-afce-b3485fd14932 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:04.568691 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2ef18f58-8429-4e6d-afce-b3485fd14932 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.137960 Oct 28 12:15:04.569261 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 207/383] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:04 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:04.732671 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e0cfa8f0-51ab-4a0e-9e61-d90a84f5e82d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:04.733199 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e0cfa8f0-51ab-4a0e-9e61-d90a84f5e82d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:04.738999 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e0cfa8f0-51ab-4a0e-9e61-d90a84f5e82d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:04.739436 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e0cfa8f0-51ab-4a0e-9e61-d90a84f5e82d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:04.740183 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e0cfa8f0-51ab-4a0e-9e61-d90a84f5e82d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:04.740603 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e0cfa8f0-51ab-4a0e-9e61-d90a84f5e82d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:04.856375 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e0cfa8f0-51ab-4a0e-9e61-d90a84f5e82d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:04.863596 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e0cfa8f0-51ab-4a0e-9e61-d90a84f5e82d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.134601 Oct 28 12:15:04.864157 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 208/384] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:04 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:05.585418 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0f067f5f-e867-4433-8bf8-43fffcad3e31 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:05.586016 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0f067f5f-e867-4433-8bf8-43fffcad3e31 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:05.592972 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0f067f5f-e867-4433-8bf8-43fffcad3e31 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:05.593411 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0f067f5f-e867-4433-8bf8-43fffcad3e31 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:05.594171 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0f067f5f-e867-4433-8bf8-43fffcad3e31 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:05.594597 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0f067f5f-e867-4433-8bf8-43fffcad3e31 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:05.717028 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0f067f5f-e867-4433-8bf8-43fffcad3e31 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:05.724214 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0f067f5f-e867-4433-8bf8-43fffcad3e31 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.142410 Oct 28 12:15:05.724826 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 209/385] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:05 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:05.880414 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3f35e3d7-1b2f-41b3-a4e2-14fcb1a5ff6e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:05.881052 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3f35e3d7-1b2f-41b3-a4e2-14fcb1a5ff6e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:05.886896 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f35e3d7-1b2f-41b3-a4e2-14fcb1a5ff6e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:05.887378 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f35e3d7-1b2f-41b3-a4e2-14fcb1a5ff6e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:05.888152 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f35e3d7-1b2f-41b3-a4e2-14fcb1a5ff6e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:05.888580 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3f35e3d7-1b2f-41b3-a4e2-14fcb1a5ff6e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:06.007129 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3f35e3d7-1b2f-41b3-a4e2-14fcb1a5ff6e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:06.014722 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3f35e3d7-1b2f-41b3-a4e2-14fcb1a5ff6e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.137921 Oct 28 12:15:06.015287 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 210/386] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:05 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:06.741427 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4db7a702-6dbb-43ff-9700-1b32e5200e2b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:06.742027 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4db7a702-6dbb-43ff-9700-1b32e5200e2b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:06.748620 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4db7a702-6dbb-43ff-9700-1b32e5200e2b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:06.749067 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4db7a702-6dbb-43ff-9700-1b32e5200e2b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:06.749858 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4db7a702-6dbb-43ff-9700-1b32e5200e2b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:06.750292 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4db7a702-6dbb-43ff-9700-1b32e5200e2b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:06.868121 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4db7a702-6dbb-43ff-9700-1b32e5200e2b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:06.875841 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4db7a702-6dbb-43ff-9700-1b32e5200e2b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.138123 Oct 28 12:15:06.876404 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 211/387] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:06 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:07.031664 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f72f3b3c-2b03-4f0b-ad44-a30352ee8be7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:07.032190 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f72f3b3c-2b03-4f0b-ad44-a30352ee8be7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:07.038032 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f72f3b3c-2b03-4f0b-ad44-a30352ee8be7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:07.038506 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f72f3b3c-2b03-4f0b-ad44-a30352ee8be7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:07.039310 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f72f3b3c-2b03-4f0b-ad44-a30352ee8be7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:07.039742 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f72f3b3c-2b03-4f0b-ad44-a30352ee8be7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:07.159222 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f72f3b3c-2b03-4f0b-ad44-a30352ee8be7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:07.166237 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f72f3b3c-2b03-4f0b-ad44-a30352ee8be7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.138265 Oct 28 12:15:07.166948 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 212/388] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:07 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:07.892217 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-309ca732-99e4-40a1-a86a-ea0c314846dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:07.892802 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-309ca732-99e4-40a1-a86a-ea0c314846dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:07.899077 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-309ca732-99e4-40a1-a86a-ea0c314846dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:07.899523 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-309ca732-99e4-40a1-a86a-ea0c314846dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:07.900288 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-309ca732-99e4-40a1-a86a-ea0c314846dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:07.900718 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-309ca732-99e4-40a1-a86a-ea0c314846dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:08.230945 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-309ca732-99e4-40a1-a86a-ea0c314846dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:08.238425 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-309ca732-99e4-40a1-a86a-ea0c314846dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.349820 Oct 28 12:15:08.239019 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 213/389] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:07 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:08.243188 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d18ac876-4f4c-4730-8dd2-4fa380ecb6cd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:08.243784 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d18ac876-4f4c-4730-8dd2-4fa380ecb6cd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:08.249365 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d18ac876-4f4c-4730-8dd2-4fa380ecb6cd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:08.249812 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d18ac876-4f4c-4730-8dd2-4fa380ecb6cd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:08.250584 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d18ac876-4f4c-4730-8dd2-4fa380ecb6cd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:08.251680 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d18ac876-4f4c-4730-8dd2-4fa380ecb6cd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:08.370596 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d18ac876-4f4c-4730-8dd2-4fa380ecb6cd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:08.377987 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d18ac876-4f4c-4730-8dd2-4fa380ecb6cd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.138015 Oct 28 12:15:08.378788 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 214/390] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:08 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:08.464198 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-aec79c6f-7c9a-464a-8087-99f0b74320d8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 5.511858 Oct 28 12:15:08.464845 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 177/391] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:02 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 5514 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:15:09.255342 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8ce53b75-4e92-4a94-a04d-4cd50bcad11c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:09.255946 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8ce53b75-4e92-4a94-a04d-4cd50bcad11c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:09.262232 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8ce53b75-4e92-4a94-a04d-4cd50bcad11c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:09.262709 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8ce53b75-4e92-4a94-a04d-4cd50bcad11c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:09.263471 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8ce53b75-4e92-4a94-a04d-4cd50bcad11c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:09.263901 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8ce53b75-4e92-4a94-a04d-4cd50bcad11c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:09.384810 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8ce53b75-4e92-4a94-a04d-4cd50bcad11c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:09.392807 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8ce53b75-4e92-4a94-a04d-4cd50bcad11c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.141118 Oct 28 12:15:09.393365 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 215/392] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:09 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:09.393944 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-356af698-ed24-4bcb-bf7f-552ffa219058 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:09.394665 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-356af698-ed24-4bcb-bf7f-552ffa219058 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:09.402129 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-356af698-ed24-4bcb-bf7f-552ffa219058 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:09.402573 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-356af698-ed24-4bcb-bf7f-552ffa219058 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:09.403411 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-356af698-ed24-4bcb-bf7f-552ffa219058 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:09.403827 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-356af698-ed24-4bcb-bf7f-552ffa219058 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:09.475484 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-144acf67-76e6-4522-94a6-0a45f04f65ae tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:09.476419 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-144acf67-76e6-4522-94a6-0a45f04f65ae tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:09.482106 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-144acf67-76e6-4522-94a6-0a45f04f65ae tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:09.482540 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-144acf67-76e6-4522-94a6-0a45f04f65ae tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:09.483494 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-144acf67-76e6-4522-94a6-0a45f04f65ae tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:09.483864 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-144acf67-76e6-4522-94a6-0a45f04f65ae tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:09.527069 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-356af698-ed24-4bcb-bf7f-552ffa219058 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:09.534602 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-356af698-ed24-4bcb-bf7f-552ffa219058 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.144592 Oct 28 12:15:09.535214 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 178/393] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:09 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:09.699543 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-144acf67-76e6-4522-94a6-0a45f04f65ae tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.227562 Oct 28 12:15:09.700275 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 216/394] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:09 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:15:10.409900 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4a389d73-ab49-48b6-a6ad-d9c8314b7042 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:10.410498 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4a389d73-ab49-48b6-a6ad-d9c8314b7042 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:10.417391 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4a389d73-ab49-48b6-a6ad-d9c8314b7042 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:10.417861 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4a389d73-ab49-48b6-a6ad-d9c8314b7042 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:10.418608 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4a389d73-ab49-48b6-a6ad-d9c8314b7042 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:10.419060 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4a389d73-ab49-48b6-a6ad-d9c8314b7042 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:10.537818 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4a389d73-ab49-48b6-a6ad-d9c8314b7042 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:10.545603 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4a389d73-ab49-48b6-a6ad-d9c8314b7042 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.139360 Oct 28 12:15:10.546416 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 179/395] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:10 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:10.551644 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b614a026-f555-4ea3-8515-ad20558174d2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:10.552272 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b614a026-f555-4ea3-8515-ad20558174d2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:10.558893 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b614a026-f555-4ea3-8515-ad20558174d2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:10.559334 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b614a026-f555-4ea3-8515-ad20558174d2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:10.560079 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b614a026-f555-4ea3-8515-ad20558174d2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:10.560498 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b614a026-f555-4ea3-8515-ad20558174d2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:10.679221 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b614a026-f555-4ea3-8515-ad20558174d2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:10.686346 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b614a026-f555-4ea3-8515-ad20558174d2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.138605 Oct 28 12:15:10.686931 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 217/396] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:10 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:10.711051 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ae1cdfe0-3ca0-4a22-a072-098ea8b7ee55 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:10.711989 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ae1cdfe0-3ca0-4a22-a072-098ea8b7ee55 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:10.718953 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ae1cdfe0-3ca0-4a22-a072-098ea8b7ee55 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:10.719400 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ae1cdfe0-3ca0-4a22-a072-098ea8b7ee55 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:10.720162 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ae1cdfe0-3ca0-4a22-a072-098ea8b7ee55 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:10.720594 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ae1cdfe0-3ca0-4a22-a072-098ea8b7ee55 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:11.562003 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4db49126-5d2a-41d7-8f55-59f8bf1dcbc1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:11.562611 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4db49126-5d2a-41d7-8f55-59f8bf1dcbc1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:11.568769 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4db49126-5d2a-41d7-8f55-59f8bf1dcbc1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:11.569210 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4db49126-5d2a-41d7-8f55-59f8bf1dcbc1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:11.569972 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4db49126-5d2a-41d7-8f55-59f8bf1dcbc1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:11.570399 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4db49126-5d2a-41d7-8f55-59f8bf1dcbc1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:11.692752 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4db49126-5d2a-41d7-8f55-59f8bf1dcbc1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:11.700394 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4db49126-5d2a-41d7-8f55-59f8bf1dcbc1 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.141957 Oct 28 12:15:11.700949 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 218/397] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:11 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:11.705091 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ee2d56a7-d6d2-4948-9059-df2e3f368a31 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:11.705680 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ee2d56a7-d6d2-4948-9059-df2e3f368a31 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:11.710993 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ee2d56a7-d6d2-4948-9059-df2e3f368a31 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:11.711460 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ee2d56a7-d6d2-4948-9059-df2e3f368a31 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:11.712210 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ee2d56a7-d6d2-4948-9059-df2e3f368a31 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:11.712635 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ee2d56a7-d6d2-4948-9059-df2e3f368a31 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:11.834333 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ee2d56a7-d6d2-4948-9059-df2e3f368a31 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:11.842133 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ee2d56a7-d6d2-4948-9059-df2e3f368a31 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.140246 Oct 28 12:15:11.842694 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 219/398] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:11 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:12.717334 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4667656f-0fae-4746-b69f-18d18c4e358a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:12.717952 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4667656f-0fae-4746-b69f-18d18c4e358a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:12.724137 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4667656f-0fae-4746-b69f-18d18c4e358a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:12.724575 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4667656f-0fae-4746-b69f-18d18c4e358a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:12.725323 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4667656f-0fae-4746-b69f-18d18c4e358a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:12.725746 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4667656f-0fae-4746-b69f-18d18c4e358a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:12.844677 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4667656f-0fae-4746-b69f-18d18c4e358a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:12.852589 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4667656f-0fae-4746-b69f-18d18c4e358a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.139361 Oct 28 12:15:12.855507 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 220/399] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:12 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:12.860182 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5e3f6381-20ae-4d57-a1d7-f8efeb99eeb7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:12.861098 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5e3f6381-20ae-4d57-a1d7-f8efeb99eeb7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:12.866901 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e3f6381-20ae-4d57-a1d7-f8efeb99eeb7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:12.867340 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e3f6381-20ae-4d57-a1d7-f8efeb99eeb7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:12.868112 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e3f6381-20ae-4d57-a1d7-f8efeb99eeb7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:12.868548 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e3f6381-20ae-4d57-a1d7-f8efeb99eeb7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:12.992869 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5e3f6381-20ae-4d57-a1d7-f8efeb99eeb7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:13.000088 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5e3f6381-20ae-4d57-a1d7-f8efeb99eeb7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.143606 Oct 28 12:15:13.000991 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 221/400] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:12 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:13.874375 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-140b199e-050f-4dcc-8786-ade8732466d0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:13.875096 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-140b199e-050f-4dcc-8786-ade8732466d0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:13.881384 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-140b199e-050f-4dcc-8786-ade8732466d0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:13.881852 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-140b199e-050f-4dcc-8786-ade8732466d0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:13.882624 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-140b199e-050f-4dcc-8786-ade8732466d0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:13.883236 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-140b199e-050f-4dcc-8786-ade8732466d0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:14.001711 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-140b199e-050f-4dcc-8786-ade8732466d0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:14.008888 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-140b199e-050f-4dcc-8786-ade8732466d0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.138478 Oct 28 12:15:14.009456 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 222/401] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:13 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:14.016582 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5731dca2-41fc-40cc-bb7f-32023eb4568e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:14.017203 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5731dca2-41fc-40cc-bb7f-32023eb4568e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:14.022748 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5731dca2-41fc-40cc-bb7f-32023eb4568e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:14.023190 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5731dca2-41fc-40cc-bb7f-32023eb4568e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:14.024088 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5731dca2-41fc-40cc-bb7f-32023eb4568e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:14.024522 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5731dca2-41fc-40cc-bb7f-32023eb4568e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:14.141685 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5731dca2-41fc-40cc-bb7f-32023eb4568e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:14.148796 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5731dca2-41fc-40cc-bb7f-32023eb4568e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.135488 Oct 28 12:15:14.149364 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 223/402] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:14 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:15.025458 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6714be4a-214a-4bc7-a44f-2d2e3fb12855 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:15.026056 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6714be4a-214a-4bc7-a44f-2d2e3fb12855 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:15.032993 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6714be4a-214a-4bc7-a44f-2d2e3fb12855 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:15.033438 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6714be4a-214a-4bc7-a44f-2d2e3fb12855 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:15.034200 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6714be4a-214a-4bc7-a44f-2d2e3fb12855 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:15.034631 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6714be4a-214a-4bc7-a44f-2d2e3fb12855 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:15.154970 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6714be4a-214a-4bc7-a44f-2d2e3fb12855 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:15.162379 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6714be4a-214a-4bc7-a44f-2d2e3fb12855 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.140493 Oct 28 12:15:15.163005 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 224/403] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:15 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:15.167833 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a3311318-f3fe-4328-8405-aea950cd474f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:15.168430 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a3311318-f3fe-4328-8405-aea950cd474f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:15.174011 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a3311318-f3fe-4328-8405-aea950cd474f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:15.174476 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a3311318-f3fe-4328-8405-aea950cd474f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:15.175255 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a3311318-f3fe-4328-8405-aea950cd474f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:15.175683 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a3311318-f3fe-4328-8405-aea950cd474f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:15.290984 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a3311318-f3fe-4328-8405-aea950cd474f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:15.298380 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a3311318-f3fe-4328-8405-aea950cd474f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.134450 Oct 28 12:15:15.298981 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 225/404] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:15 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:15.384902 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ae1cdfe0-3ca0-4a22-a072-098ea8b7ee55 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 4.677277 Oct 28 12:15:15.385543 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 180/405] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:10 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 4679 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:15:16.179593 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4f9243f1-9339-436c-8e29-36317cded6fc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:16.180193 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4f9243f1-9339-436c-8e29-36317cded6fc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:16.187069 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f9243f1-9339-436c-8e29-36317cded6fc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:16.187513 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f9243f1-9339-436c-8e29-36317cded6fc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:16.188273 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f9243f1-9339-436c-8e29-36317cded6fc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:16.188701 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f9243f1-9339-436c-8e29-36317cded6fc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:16.311817 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4f9243f1-9339-436c-8e29-36317cded6fc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:16.317405 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-79104a4f-7f52-46df-bbc6-b76aa8a3020c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:16.317405 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-79104a4f-7f52-46df-bbc6-b76aa8a3020c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:16.319206 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4f9243f1-9339-436c-8e29-36317cded6fc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.143107 Oct 28 12:15:16.319742 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 226/406] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:16 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:16.335287 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-79104a4f-7f52-46df-bbc6-b76aa8a3020c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:16.335728 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-79104a4f-7f52-46df-bbc6-b76aa8a3020c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:16.336504 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-79104a4f-7f52-46df-bbc6-b76aa8a3020c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:16.336928 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-79104a4f-7f52-46df-bbc6-b76aa8a3020c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:16.396935 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-60b49487-be7a-4247-baed-ffd5eec7767c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:16.397902 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-60b49487-be7a-4247-baed-ffd5eec7767c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:16.404288 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60b49487-be7a-4247-baed-ffd5eec7767c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:16.404745 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60b49487-be7a-4247-baed-ffd5eec7767c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:16.405519 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60b49487-be7a-4247-baed-ffd5eec7767c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:16.405949 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60b49487-be7a-4247-baed-ffd5eec7767c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:16.466167 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-79104a4f-7f52-46df-bbc6-b76aa8a3020c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:16.471753 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-60b49487-be7a-4247-baed-ffd5eec7767c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.078305 Oct 28 12:15:16.472585 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 227/407] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:16 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:15:16.474233 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-79104a4f-7f52-46df-bbc6-b76aa8a3020c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.162209 Oct 28 12:15:16.474817 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 181/408] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:16 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:17.336318 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2671be7a-974d-4eb5-bec3-1dfe50070888 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:17.337133 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2671be7a-974d-4eb5-bec3-1dfe50070888 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:17.344649 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2671be7a-974d-4eb5-bec3-1dfe50070888 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:17.345098 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2671be7a-974d-4eb5-bec3-1dfe50070888 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:17.345865 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2671be7a-974d-4eb5-bec3-1dfe50070888 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:17.346296 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2671be7a-974d-4eb5-bec3-1dfe50070888 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:17.469765 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2671be7a-974d-4eb5-bec3-1dfe50070888 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:17.477411 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2671be7a-974d-4eb5-bec3-1dfe50070888 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1501 microversion: 2.1 time: 0.145014 Oct 28 12:15:17.477968 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 228/409] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:17 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1501 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:17.484419 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3c81de1b-1855-4063-a982-ecfdf1d58013 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:17.485184 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3c81de1b-1855-4063-a982-ecfdf1d58013 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:17.492266 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c81de1b-1855-4063-a982-ecfdf1d58013 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:17.492804 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c81de1b-1855-4063-a982-ecfdf1d58013 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:17.493691 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c81de1b-1855-4063-a982-ecfdf1d58013 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:17.494123 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c81de1b-1855-4063-a982-ecfdf1d58013 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:17.496900 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fd020ae8-4dfa-41e8-aa12-980dd5ef618f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:17.497505 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fd020ae8-4dfa-41e8-aa12-980dd5ef618f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:17.503222 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fd020ae8-4dfa-41e8-aa12-980dd5ef618f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:17.503811 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fd020ae8-4dfa-41e8-aa12-980dd5ef618f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:17.504577 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fd020ae8-4dfa-41e8-aa12-980dd5ef618f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:17.505005 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fd020ae8-4dfa-41e8-aa12-980dd5ef618f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:17.625771 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fd020ae8-4dfa-41e8-aa12-980dd5ef618f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:17.632908 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fd020ae8-4dfa-41e8-aa12-980dd5ef618f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.142282 Oct 28 12:15:17.633470 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 229/410] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:17 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:17.638449 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3266fa7a-f0fc-4cb8-be8c-6359b9e9d186 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b662750d-87ae-4c77-8989-49e2ae5c8e02"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:17.639509 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3266fa7a-f0fc-4cb8-be8c-6359b9e9d186 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:17.645039 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3266fa7a-f0fc-4cb8-be8c-6359b9e9d186 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:17.645485 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3266fa7a-f0fc-4cb8-be8c-6359b9e9d186 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:17.646274 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3266fa7a-f0fc-4cb8-be8c-6359b9e9d186 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:17.646720 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3266fa7a-f0fc-4cb8-be8c-6359b9e9d186 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:17.670364 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-3266fa7a-f0fc-4cb8-be8c-6359b9e9d186 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] HTTP exception thrown: Cannot 'attach_volume' instance 28b1cf11-e525-409b-83da-1c26e1d9937d while it is in vm_state rescued Oct 28 12:15:17.670957 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3266fa7a-f0fc-4cb8-be8c-6359b9e9d186 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Returning 409 to user: Cannot 'attach_volume' instance 28b1cf11-e525-409b-83da-1c26e1d9937d while it is in vm_state rescued {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:15:17.672018 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3266fa7a-f0fc-4cb8-be8c-6359b9e9d186 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "POST /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.037657 Oct 28 12:15:17.672541 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 230/411] 10.222.0.37 () {60 vars in 1322 bytes} [Thu Oct 28 12:15:17 2021] POST /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments => generated 152 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 12:15:17.680472 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0500c3bd-52e0-4313-bc1e-184232176e8c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:17.680993 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0500c3bd-52e0-4313-bc1e-184232176e8c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:17.687434 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0500c3bd-52e0-4313-bc1e-184232176e8c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:17.687876 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0500c3bd-52e0-4313-bc1e-184232176e8c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:17.688637 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0500c3bd-52e0-4313-bc1e-184232176e8c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:17.689069 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0500c3bd-52e0-4313-bc1e-184232176e8c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:17.753942 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0500c3bd-52e0-4313-bc1e-184232176e8c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "POST /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/action" status: 202 len: 0 microversion: 2.1 time: 0.076550 Oct 28 12:15:17.754486 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 231/412] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:15:17 2021] POST /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:15:17.762275 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-af4edcec-a7e8-4498-9306-4378f4dc9311 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:17.762979 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-af4edcec-a7e8-4498-9306-4378f4dc9311 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:17.768699 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-af4edcec-a7e8-4498-9306-4378f4dc9311 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:17.769131 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-af4edcec-a7e8-4498-9306-4378f4dc9311 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:17.769879 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-af4edcec-a7e8-4498-9306-4378f4dc9311 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:17.770300 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-af4edcec-a7e8-4498-9306-4378f4dc9311 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:17.890134 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-af4edcec-a7e8-4498-9306-4378f4dc9311 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:17.897363 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-af4edcec-a7e8-4498-9306-4378f4dc9311 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1509 microversion: 2.1 time: 0.138695 Oct 28 12:15:17.897915 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 232/413] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:17 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1509 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:18.649613 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4ae8fbd1-43b4-45da-b268-5e3807c9c165 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:18.650218 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4ae8fbd1-43b4-45da-b268-5e3807c9c165 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:18.657115 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ae8fbd1-43b4-45da-b268-5e3807c9c165 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:18.657565 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ae8fbd1-43b4-45da-b268-5e3807c9c165 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:18.658335 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ae8fbd1-43b4-45da-b268-5e3807c9c165 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:18.658962 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ae8fbd1-43b4-45da-b268-5e3807c9c165 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:18.782051 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4ae8fbd1-43b4-45da-b268-5e3807c9c165 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:18.789295 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4ae8fbd1-43b4-45da-b268-5e3807c9c165 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.143347 Oct 28 12:15:18.789852 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 233/414] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:18 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:18.915833 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9b8e7113-ed74-4903-a23c-c0d33cb9e5d6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:18.916423 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9b8e7113-ed74-4903-a23c-c0d33cb9e5d6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:18.924167 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9b8e7113-ed74-4903-a23c-c0d33cb9e5d6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:18.924603 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9b8e7113-ed74-4903-a23c-c0d33cb9e5d6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:18.925350 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9b8e7113-ed74-4903-a23c-c0d33cb9e5d6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:18.925788 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9b8e7113-ed74-4903-a23c-c0d33cb9e5d6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:19.044234 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9b8e7113-ed74-4903-a23c-c0d33cb9e5d6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:19.051699 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9b8e7113-ed74-4903-a23c-c0d33cb9e5d6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1509 microversion: 2.1 time: 0.139483 Oct 28 12:15:19.052245 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 234/415] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:18 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1509 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:19.805328 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bc12955b-1eee-4693-8da6-39ab4db162af tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:19.805948 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bc12955b-1eee-4693-8da6-39ab4db162af tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:19.812293 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc12955b-1eee-4693-8da6-39ab4db162af tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:19.812836 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc12955b-1eee-4693-8da6-39ab4db162af tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:19.813743 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc12955b-1eee-4693-8da6-39ab4db162af tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:19.814168 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc12955b-1eee-4693-8da6-39ab4db162af tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:19.932778 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bc12955b-1eee-4693-8da6-39ab4db162af tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:19.939894 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bc12955b-1eee-4693-8da6-39ab4db162af tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.138232 Oct 28 12:15:19.940460 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 235/416] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:19 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:20.069444 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-572d3f09-bcde-4eb4-b109-b0340e8b6241 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:20.069967 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-572d3f09-bcde-4eb4-b109-b0340e8b6241 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:20.076393 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-572d3f09-bcde-4eb4-b109-b0340e8b6241 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:20.076842 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-572d3f09-bcde-4eb4-b109-b0340e8b6241 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:20.077602 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-572d3f09-bcde-4eb4-b109-b0340e8b6241 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:20.078040 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-572d3f09-bcde-4eb4-b109-b0340e8b6241 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:20.198707 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-572d3f09-bcde-4eb4-b109-b0340e8b6241 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:20.206643 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-572d3f09-bcde-4eb4-b109-b0340e8b6241 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1509 microversion: 2.1 time: 0.140744 Oct 28 12:15:20.207220 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 236/417] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:20 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1509 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:20.955749 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ea498413-df5e-4a47-b245-0579cc0dce6f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:20.956351 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ea498413-df5e-4a47-b245-0579cc0dce6f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:20.962563 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ea498413-df5e-4a47-b245-0579cc0dce6f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:20.963032 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ea498413-df5e-4a47-b245-0579cc0dce6f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:20.963793 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ea498413-df5e-4a47-b245-0579cc0dce6f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:20.964220 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ea498413-df5e-4a47-b245-0579cc0dce6f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:21.081247 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ea498413-df5e-4a47-b245-0579cc0dce6f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:21.088345 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ea498413-df5e-4a47-b245-0579cc0dce6f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.136288 Oct 28 12:15:21.088909 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 237/418] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:20 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:21.222743 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a6ada40e-4b28-4049-bc4b-a5adeb9f06b5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:21.223378 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a6ada40e-4b28-4049-bc4b-a5adeb9f06b5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:21.229055 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6ada40e-4b28-4049-bc4b-a5adeb9f06b5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:21.229496 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6ada40e-4b28-4049-bc4b-a5adeb9f06b5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:21.230266 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6ada40e-4b28-4049-bc4b-a5adeb9f06b5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:21.230783 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6ada40e-4b28-4049-bc4b-a5adeb9f06b5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:21.293360 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3c81de1b-1855-4063-a982-ecfdf1d58013 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 3.812949 Oct 28 12:15:21.295174 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 182/419] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:17 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 3816 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:15:21.376864 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a6ada40e-4b28-4049-bc4b-a5adeb9f06b5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:21.384280 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a6ada40e-4b28-4049-bc4b-a5adeb9f06b5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1509 microversion: 2.1 time: 0.165094 Oct 28 12:15:21.384844 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 238/420] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:21 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:22.106195 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-80f614e8-f0fa-41e5-8aa4-84055d945e88 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:22.106902 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-80f614e8-f0fa-41e5-8aa4-84055d945e88 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:22.113653 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-80f614e8-f0fa-41e5-8aa4-84055d945e88 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:22.114084 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-80f614e8-f0fa-41e5-8aa4-84055d945e88 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:22.114864 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-80f614e8-f0fa-41e5-8aa4-84055d945e88 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:22.115286 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-80f614e8-f0fa-41e5-8aa4-84055d945e88 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:22.238672 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-80f614e8-f0fa-41e5-8aa4-84055d945e88 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:22.251336 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-80f614e8-f0fa-41e5-8aa4-84055d945e88 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.149711 Oct 28 12:15:22.251999 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 183/421] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:22 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:22.308184 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e84c9e7f-13c5-487b-acdf-6205f321aed3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:22.309230 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e84c9e7f-13c5-487b-acdf-6205f321aed3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:22.315840 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e84c9e7f-13c5-487b-acdf-6205f321aed3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:22.316301 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e84c9e7f-13c5-487b-acdf-6205f321aed3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:22.317249 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e84c9e7f-13c5-487b-acdf-6205f321aed3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:22.317683 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e84c9e7f-13c5-487b-acdf-6205f321aed3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:22.389769 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e84c9e7f-13c5-487b-acdf-6205f321aed3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.087990 Oct 28 12:15:22.390780 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 239/422] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:22 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:15:22.400928 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-afb20f74-e2e7-49c8-96af-038f67da3a78 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:22.401583 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-afb20f74-e2e7-49c8-96af-038f67da3a78 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:22.409693 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-afb20f74-e2e7-49c8-96af-038f67da3a78 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:22.410457 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-afb20f74-e2e7-49c8-96af-038f67da3a78 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:22.411800 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-afb20f74-e2e7-49c8-96af-038f67da3a78 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:22.412410 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-afb20f74-e2e7-49c8-96af-038f67da3a78 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:22.539184 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-afb20f74-e2e7-49c8-96af-038f67da3a78 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:22.547458 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-afb20f74-e2e7-49c8-96af-038f67da3a78 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1509 microversion: 2.1 time: 0.150145 Oct 28 12:15:22.548029 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 184/423] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:22 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:23.269477 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b5ca2e6f-61ff-41ab-8bb1-b845828c709f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:23.270168 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b5ca2e6f-61ff-41ab-8bb1-b845828c709f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:23.276815 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b5ca2e6f-61ff-41ab-8bb1-b845828c709f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:23.277253 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b5ca2e6f-61ff-41ab-8bb1-b845828c709f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:23.278016 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b5ca2e6f-61ff-41ab-8bb1-b845828c709f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:23.278442 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b5ca2e6f-61ff-41ab-8bb1-b845828c709f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:23.401296 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2bfcd573-bd20-49c0-9cec-44c67e4dd7b4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:23.402208 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2bfcd573-bd20-49c0-9cec-44c67e4dd7b4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:23.404738 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b5ca2e6f-61ff-41ab-8bb1-b845828c709f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:23.408744 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2bfcd573-bd20-49c0-9cec-44c67e4dd7b4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:23.410259 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2bfcd573-bd20-49c0-9cec-44c67e4dd7b4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:23.413305 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2bfcd573-bd20-49c0-9cec-44c67e4dd7b4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:23.414834 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2bfcd573-bd20-49c0-9cec-44c67e4dd7b4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:23.424952 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b5ca2e6f-61ff-41ab-8bb1-b845828c709f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.157369 Oct 28 12:15:23.435076 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 240/424] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:23 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:23.566322 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9e1fd846-57f3-4d3c-9dcf-f7ced47e17e8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:23.567761 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9e1fd846-57f3-4d3c-9dcf-f7ced47e17e8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:23.575828 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9e1fd846-57f3-4d3c-9dcf-f7ced47e17e8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:23.576541 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9e1fd846-57f3-4d3c-9dcf-f7ced47e17e8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:23.577631 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9e1fd846-57f3-4d3c-9dcf-f7ced47e17e8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:23.578228 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9e1fd846-57f3-4d3c-9dcf-f7ced47e17e8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:23.585886 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2bfcd573-bd20-49c0-9cec-44c67e4dd7b4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.188007 Oct 28 12:15:23.599860 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 185/425] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:23 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:15:23.725763 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9e1fd846-57f3-4d3c-9dcf-f7ced47e17e8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:23.733641 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9e1fd846-57f3-4d3c-9dcf-f7ced47e17e8 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1509 microversion: 2.1 time: 0.172465 Oct 28 12:15:23.734416 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 241/426] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:23 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:24.443510 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-82da5a76-7ef2-469a-9774-55c176ac853b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:24.444218 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-82da5a76-7ef2-469a-9774-55c176ac853b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:24.451919 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-82da5a76-7ef2-469a-9774-55c176ac853b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:24.452366 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-82da5a76-7ef2-469a-9774-55c176ac853b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:24.453131 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-82da5a76-7ef2-469a-9774-55c176ac853b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:24.453564 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-82da5a76-7ef2-469a-9774-55c176ac853b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:24.581748 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-82da5a76-7ef2-469a-9774-55c176ac853b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:24.590267 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-82da5a76-7ef2-469a-9774-55c176ac853b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.150799 Oct 28 12:15:24.591065 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 186/427] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:24 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:24.601634 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-046477cb-87e1-465c-8294-9a45c454aa6f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:24.601634 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-046477cb-87e1-465c-8294-9a45c454aa6f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:24.614241 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-046477cb-87e1-465c-8294-9a45c454aa6f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:24.614977 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-046477cb-87e1-465c-8294-9a45c454aa6f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:24.615913 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-046477cb-87e1-465c-8294-9a45c454aa6f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:24.616397 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-046477cb-87e1-465c-8294-9a45c454aa6f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:24.751844 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-da6af257-3596-4d96-b6ef-5eabcd3f65db tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:24.752440 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-da6af257-3596-4d96-b6ef-5eabcd3f65db tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:24.758937 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da6af257-3596-4d96-b6ef-5eabcd3f65db tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:24.759370 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da6af257-3596-4d96-b6ef-5eabcd3f65db tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:24.760132 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da6af257-3596-4d96-b6ef-5eabcd3f65db tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:24.760685 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da6af257-3596-4d96-b6ef-5eabcd3f65db tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:24.893990 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-da6af257-3596-4d96-b6ef-5eabcd3f65db tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:24.901058 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-da6af257-3596-4d96-b6ef-5eabcd3f65db tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1509 microversion: 2.1 time: 0.152806 Oct 28 12:15:24.901590 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 187/428] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:24 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:25.611332 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ee64fb09-47cf-4c03-9b1e-4f8d7e394f27 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:25.611945 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ee64fb09-47cf-4c03-9b1e-4f8d7e394f27 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:25.618052 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee64fb09-47cf-4c03-9b1e-4f8d7e394f27 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:25.618495 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee64fb09-47cf-4c03-9b1e-4f8d7e394f27 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:25.619295 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee64fb09-47cf-4c03-9b1e-4f8d7e394f27 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:25.619721 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee64fb09-47cf-4c03-9b1e-4f8d7e394f27 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:25.763349 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ee64fb09-47cf-4c03-9b1e-4f8d7e394f27 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:25.770486 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ee64fb09-47cf-4c03-9b1e-4f8d7e394f27 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.162836 Oct 28 12:15:25.771085 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 188/429] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:25 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:25.917650 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c8ac7613-6d19-4c28-97e0-bf02b50a5f97 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:25.918326 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c8ac7613-6d19-4c28-97e0-bf02b50a5f97 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:25.924325 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c8ac7613-6d19-4c28-97e0-bf02b50a5f97 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:25.924765 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c8ac7613-6d19-4c28-97e0-bf02b50a5f97 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:25.925525 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c8ac7613-6d19-4c28-97e0-bf02b50a5f97 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:25.925949 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c8ac7613-6d19-4c28-97e0-bf02b50a5f97 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:26.070074 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c8ac7613-6d19-4c28-97e0-bf02b50a5f97 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:26.078990 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c8ac7613-6d19-4c28-97e0-bf02b50a5f97 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1509 microversion: 2.1 time: 0.164992 Oct 28 12:15:26.079579 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 189/430] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:25 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:26.787008 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-21af46e0-7605-45a2-9780-7c776df3a44d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:26.787608 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-21af46e0-7605-45a2-9780-7c776df3a44d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:26.795574 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-21af46e0-7605-45a2-9780-7c776df3a44d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:26.796379 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-21af46e0-7605-45a2-9780-7c776df3a44d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:26.797225 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-21af46e0-7605-45a2-9780-7c776df3a44d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:26.797662 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-21af46e0-7605-45a2-9780-7c776df3a44d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:26.933829 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-21af46e0-7605-45a2-9780-7c776df3a44d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:26.941038 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-21af46e0-7605-45a2-9780-7c776df3a44d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.157559 Oct 28 12:15:26.941682 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 190/431] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:26 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:27.098210 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f960a524-4479-4d27-9887-52ad732357d4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:27.099114 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f960a524-4479-4d27-9887-52ad732357d4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:27.106335 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f960a524-4479-4d27-9887-52ad732357d4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:27.106735 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f960a524-4479-4d27-9887-52ad732357d4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:27.107670 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f960a524-4479-4d27-9887-52ad732357d4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:27.108005 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f960a524-4479-4d27-9887-52ad732357d4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:27.240384 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f960a524-4479-4d27-9887-52ad732357d4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:27.248230 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f960a524-4479-4d27-9887-52ad732357d4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1509 microversion: 2.1 time: 0.155661 Oct 28 12:15:27.248791 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 191/432] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:27 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:27.711692 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-41ed77a1-e758-47ec-bc29-93789441ec2e req-8cb8ef80-4aae-4b88-a9fb-0722a99b86ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "948c9fed-b55d-4b55-9971-f4db721088aa", "name": "network-vif-plugged", "status": "completed", "tag": "1391e735-fffa-4d34-9821-38ee846f2984"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:27.713291 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:15:27.713291 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:15:27.721049 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-41ed77a1-e758-47ec-bc29-93789441ec2e req-8cb8ef80-4aae-4b88-a9fb-0722a99b86ad service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:27.721601 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-41ed77a1-e758-47ec-bc29-93789441ec2e req-8cb8ef80-4aae-4b88-a9fb-0722a99b86ad service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:27.741424 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-41ed77a1-e758-47ec-bc29-93789441ec2e req-8cb8ef80-4aae-4b88-a9fb-0722a99b86ad service nova] Creating event network-vif-plugged:1391e735-fffa-4d34-9821-38ee846f2984 for instance 948c9fed-b55d-4b55-9971-f4db721088aa on hv-cinder-81571 Oct 28 12:15:27.746465 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-41ed77a1-e758-47ec-bc29-93789441ec2e req-8cb8ef80-4aae-4b88-a9fb-0722a99b86ad service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038957 Oct 28 12:15:27.747432 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 192/433] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:15:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:15:27.962140 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-428d6b55-3733-454e-8238-359aa4aedf23 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:27.962965 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-428d6b55-3733-454e-8238-359aa4aedf23 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:27.969981 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-428d6b55-3733-454e-8238-359aa4aedf23 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:27.970428 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-428d6b55-3733-454e-8238-359aa4aedf23 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:27.971293 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-428d6b55-3733-454e-8238-359aa4aedf23 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:27.971726 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-428d6b55-3733-454e-8238-359aa4aedf23 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:28.119925 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-428d6b55-3733-454e-8238-359aa4aedf23 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:28.130192 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-428d6b55-3733-454e-8238-359aa4aedf23 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.172531 Oct 28 12:15:28.131050 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 193/434] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:27 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:28.265381 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9405ede7-9f29-40cf-a9e2-6eb58d5b0ef0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:28.265985 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9405ede7-9f29-40cf-a9e2-6eb58d5b0ef0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:28.272049 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9405ede7-9f29-40cf-a9e2-6eb58d5b0ef0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:28.273568 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9405ede7-9f29-40cf-a9e2-6eb58d5b0ef0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:28.275059 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9405ede7-9f29-40cf-a9e2-6eb58d5b0ef0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:28.275817 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9405ede7-9f29-40cf-a9e2-6eb58d5b0ef0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:28.409598 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9405ede7-9f29-40cf-a9e2-6eb58d5b0ef0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:28.418207 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9405ede7-9f29-40cf-a9e2-6eb58d5b0ef0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1509 microversion: 2.1 time: 0.156803 Oct 28 12:15:28.418823 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 194/435] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:28 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:29.101499 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-046477cb-87e1-465c-8294-9a45c454aa6f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 4.506274 Oct 28 12:15:29.106004 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 242/436] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:24 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 4508 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:15:29.149511 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8da38ca1-b0d4-4533-8d0a-aca06e787501 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:29.150718 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8da38ca1-b0d4-4533-8d0a-aca06e787501 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:29.159158 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8da38ca1-b0d4-4533-8d0a-aca06e787501 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:29.160017 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8da38ca1-b0d4-4533-8d0a-aca06e787501 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:29.160793 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8da38ca1-b0d4-4533-8d0a-aca06e787501 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:29.161616 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8da38ca1-b0d4-4533-8d0a-aca06e787501 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:29.307583 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8da38ca1-b0d4-4533-8d0a-aca06e787501 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:29.315669 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8da38ca1-b0d4-4533-8d0a-aca06e787501 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.170943 Oct 28 12:15:29.316329 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 195/437] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:29 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:29.438101 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ff3777ba-5c1f-4857-86f6-145ff74210b0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:29.439006 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ff3777ba-5c1f-4857-86f6-145ff74210b0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:29.445933 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ff3777ba-5c1f-4857-86f6-145ff74210b0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:29.446413 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ff3777ba-5c1f-4857-86f6-145ff74210b0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:29.447292 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ff3777ba-5c1f-4857-86f6-145ff74210b0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:29.447726 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ff3777ba-5c1f-4857-86f6-145ff74210b0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:29.687036 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ff3777ba-5c1f-4857-86f6-145ff74210b0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:29.698078 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ff3777ba-5c1f-4857-86f6-145ff74210b0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1509 microversion: 2.1 time: 0.265716 Oct 28 12:15:29.711076 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 243/438] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:29 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1509 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:30.113472 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4983a014-f3e7-4e7d-97f3-fa78003ccf89 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:30.114381 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4983a014-f3e7-4e7d-97f3-fa78003ccf89 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:30.121071 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4983a014-f3e7-4e7d-97f3-fa78003ccf89 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:30.121786 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4983a014-f3e7-4e7d-97f3-fa78003ccf89 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:30.122890 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4983a014-f3e7-4e7d-97f3-fa78003ccf89 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:30.123565 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4983a014-f3e7-4e7d-97f3-fa78003ccf89 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:30.215750 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4983a014-f3e7-4e7d-97f3-fa78003ccf89 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.104571 Oct 28 12:15:30.217173 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 196/439] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:30 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:15:30.333770 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-00bcabce-9135-42a3-8c7c-5aba7c9cc516 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:30.334367 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-00bcabce-9135-42a3-8c7c-5aba7c9cc516 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:30.341014 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-00bcabce-9135-42a3-8c7c-5aba7c9cc516 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:30.341469 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-00bcabce-9135-42a3-8c7c-5aba7c9cc516 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:30.342208 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-00bcabce-9135-42a3-8c7c-5aba7c9cc516 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:30.342627 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-00bcabce-9135-42a3-8c7c-5aba7c9cc516 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:30.560214 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-00bcabce-9135-42a3-8c7c-5aba7c9cc516 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:30.571782 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-00bcabce-9135-42a3-8c7c-5aba7c9cc516 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.242216 Oct 28 12:15:30.572628 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 244/440] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:30 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:30.725796 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8cd0cfcc-3b81-4ab8-82dd-912bb54662ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:30.726554 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8cd0cfcc-3b81-4ab8-82dd-912bb54662ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:30.734254 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8cd0cfcc-3b81-4ab8-82dd-912bb54662ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:30.735019 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8cd0cfcc-3b81-4ab8-82dd-912bb54662ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:30.735793 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8cd0cfcc-3b81-4ab8-82dd-912bb54662ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:30.736377 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8cd0cfcc-3b81-4ab8-82dd-912bb54662ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:30.911228 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8cd0cfcc-3b81-4ab8-82dd-912bb54662ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:30.924587 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8cd0cfcc-3b81-4ab8-82dd-912bb54662ce tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1509 microversion: 2.1 time: 0.208650 Oct 28 12:15:30.925841 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 197/441] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:30 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1509 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:31.229298 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c20f6ea8-40ab-44df-9ee6-9a5e5293d8b8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:31.231106 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c20f6ea8-40ab-44df-9ee6-9a5e5293d8b8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:31.238223 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c20f6ea8-40ab-44df-9ee6-9a5e5293d8b8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:31.238801 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c20f6ea8-40ab-44df-9ee6-9a5e5293d8b8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:31.239659 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c20f6ea8-40ab-44df-9ee6-9a5e5293d8b8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:31.240360 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c20f6ea8-40ab-44df-9ee6-9a5e5293d8b8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:31.590431 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1d7b4c83-b567-489d-a929-75e0c63d44ef tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:31.591737 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1d7b4c83-b567-489d-a929-75e0c63d44ef tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:31.597773 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1d7b4c83-b567-489d-a929-75e0c63d44ef tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:31.598233 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1d7b4c83-b567-489d-a929-75e0c63d44ef tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:31.599273 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1d7b4c83-b567-489d-a929-75e0c63d44ef tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:31.599956 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1d7b4c83-b567-489d-a929-75e0c63d44ef tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:31.762190 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1d7b4c83-b567-489d-a929-75e0c63d44ef tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:31.769432 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1d7b4c83-b567-489d-a929-75e0c63d44ef tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.183276 Oct 28 12:15:31.769994 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 198/442] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:31 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:31.942752 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f6704f8f-6ea5-44c9-aeb5-59e278332a77 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:31.943360 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f6704f8f-6ea5-44c9-aeb5-59e278332a77 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:31.949812 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f6704f8f-6ea5-44c9-aeb5-59e278332a77 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:31.950257 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f6704f8f-6ea5-44c9-aeb5-59e278332a77 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:31.951048 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f6704f8f-6ea5-44c9-aeb5-59e278332a77 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:31.951479 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f6704f8f-6ea5-44c9-aeb5-59e278332a77 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:32.079174 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f6704f8f-6ea5-44c9-aeb5-59e278332a77 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:32.087760 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f6704f8f-6ea5-44c9-aeb5-59e278332a77 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1509 microversion: 2.1 time: 0.148441 Oct 28 12:15:32.090718 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 199/443] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:31 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:32.787204 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7f3b2604-72c5-4cc1-aa78-6cb1ca763059 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:32.788128 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7f3b2604-72c5-4cc1-aa78-6cb1ca763059 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:32.795983 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7f3b2604-72c5-4cc1-aa78-6cb1ca763059 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:32.796878 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7f3b2604-72c5-4cc1-aa78-6cb1ca763059 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:32.797822 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7f3b2604-72c5-4cc1-aa78-6cb1ca763059 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:32.798389 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7f3b2604-72c5-4cc1-aa78-6cb1ca763059 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:33.140058 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7f3b2604-72c5-4cc1-aa78-6cb1ca763059 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:33.148540 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7f3b2604-72c5-4cc1-aa78-6cb1ca763059 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.365375 Oct 28 12:15:33.149228 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 200/444] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:32 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:33.154547 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a36e19dd-92fe-4f33-8bd7-a84485cd5f02 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:33.155412 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a36e19dd-92fe-4f33-8bd7-a84485cd5f02 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:33.161271 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a36e19dd-92fe-4f33-8bd7-a84485cd5f02 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:33.161840 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a36e19dd-92fe-4f33-8bd7-a84485cd5f02 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:33.162884 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a36e19dd-92fe-4f33-8bd7-a84485cd5f02 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:33.163822 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a36e19dd-92fe-4f33-8bd7-a84485cd5f02 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:33.393005 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a36e19dd-92fe-4f33-8bd7-a84485cd5f02 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:33.403028 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a36e19dd-92fe-4f33-8bd7-a84485cd5f02 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1509 microversion: 2.1 time: 0.251876 Oct 28 12:15:33.403888 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 201/445] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:33 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1509 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:34.165908 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e541099f-ad89-4dcd-b280-b58b16aed8b3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:34.168685 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e541099f-ad89-4dcd-b280-b58b16aed8b3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:34.189409 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e541099f-ad89-4dcd-b280-b58b16aed8b3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:34.191848 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e541099f-ad89-4dcd-b280-b58b16aed8b3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:34.193362 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e541099f-ad89-4dcd-b280-b58b16aed8b3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:34.193948 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e541099f-ad89-4dcd-b280-b58b16aed8b3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:34.486244 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e541099f-ad89-4dcd-b280-b58b16aed8b3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:34.505709 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e541099f-ad89-4dcd-b280-b58b16aed8b3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.343445 Oct 28 12:15:34.506292 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 202/446] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:34 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:34.528370 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-35032437-f8d0-456b-9f96-f0db67ec983e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:34.529347 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-35032437-f8d0-456b-9f96-f0db67ec983e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:34.539264 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-35032437-f8d0-456b-9f96-f0db67ec983e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:34.539950 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-35032437-f8d0-456b-9f96-f0db67ec983e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:34.541531 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-35032437-f8d0-456b-9f96-f0db67ec983e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:34.542135 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-35032437-f8d0-456b-9f96-f0db67ec983e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:34.812959 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-35032437-f8d0-456b-9f96-f0db67ec983e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:34.821754 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-35032437-f8d0-456b-9f96-f0db67ec983e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1509 microversion: 2.1 time: 0.298631 Oct 28 12:15:34.822497 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 203/447] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:34 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1509 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:35.522148 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6f511fd2-793a-4982-bfdd-39e44dca14af tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:35.522844 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6f511fd2-793a-4982-bfdd-39e44dca14af tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:35.533501 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6f511fd2-793a-4982-bfdd-39e44dca14af tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:35.534054 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6f511fd2-793a-4982-bfdd-39e44dca14af tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:35.537036 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6f511fd2-793a-4982-bfdd-39e44dca14af tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:35.537555 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6f511fd2-793a-4982-bfdd-39e44dca14af tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:35.713097 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6f511fd2-793a-4982-bfdd-39e44dca14af tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:35.722603 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6f511fd2-793a-4982-bfdd-39e44dca14af tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.204080 Oct 28 12:15:35.725109 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 204/448] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:35 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:35.803437 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c20f6ea8-40ab-44df-9ee6-9a5e5293d8b8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 4.577740 Oct 28 12:15:35.804673 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 245/449] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:31 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 4580 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:15:35.841633 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a5484fbd-4f28-4dcd-a2e0-c7e6f1f9036d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:35.842496 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a5484fbd-4f28-4dcd-a2e0-c7e6f1f9036d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:35.854707 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a5484fbd-4f28-4dcd-a2e0-c7e6f1f9036d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:35.858495 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a5484fbd-4f28-4dcd-a2e0-c7e6f1f9036d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:35.862219 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a5484fbd-4f28-4dcd-a2e0-c7e6f1f9036d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:35.862709 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a5484fbd-4f28-4dcd-a2e0-c7e6f1f9036d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:36.081908 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a5484fbd-4f28-4dcd-a2e0-c7e6f1f9036d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:36.099501 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a5484fbd-4f28-4dcd-a2e0-c7e6f1f9036d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1509 microversion: 2.1 time: 0.264379 Oct 28 12:15:36.100636 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 205/450] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:35 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1509 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:36.740647 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3ac25ac4-e2cb-4e9f-a8c6-ddc7eed6ffa6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:36.741335 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3ac25ac4-e2cb-4e9f-a8c6-ddc7eed6ffa6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:36.753919 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3ac25ac4-e2cb-4e9f-a8c6-ddc7eed6ffa6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:36.754366 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3ac25ac4-e2cb-4e9f-a8c6-ddc7eed6ffa6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:36.755465 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3ac25ac4-e2cb-4e9f-a8c6-ddc7eed6ffa6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:36.755590 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3ac25ac4-e2cb-4e9f-a8c6-ddc7eed6ffa6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:36.815441 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ee7915b8-ea83-4a31-ba2f-50bdadddade5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:36.817173 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ee7915b8-ea83-4a31-ba2f-50bdadddade5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:36.825981 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee7915b8-ea83-4a31-ba2f-50bdadddade5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:36.827159 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee7915b8-ea83-4a31-ba2f-50bdadddade5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:36.828160 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee7915b8-ea83-4a31-ba2f-50bdadddade5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:36.828789 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee7915b8-ea83-4a31-ba2f-50bdadddade5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:36.955403 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ee7915b8-ea83-4a31-ba2f-50bdadddade5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.143666 Oct 28 12:15:36.956096 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 206/451] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:36 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:15:37.043997 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3ac25ac4-e2cb-4e9f-a8c6-ddc7eed6ffa6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:37.062334 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3ac25ac4-e2cb-4e9f-a8c6-ddc7eed6ffa6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1317 microversion: 2.1 time: 0.325508 Oct 28 12:15:37.064145 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 246/452] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:36 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:37.116734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-507b5711-bbf7-4591-ab76-6336303328af tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:37.117446 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-507b5711-bbf7-4591-ab76-6336303328af tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:37.125058 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-507b5711-bbf7-4591-ab76-6336303328af tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:37.125767 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-507b5711-bbf7-4591-ab76-6336303328af tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:37.126719 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-507b5711-bbf7-4591-ab76-6336303328af tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:37.127294 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-507b5711-bbf7-4591-ab76-6336303328af tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:37.317740 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-507b5711-bbf7-4591-ab76-6336303328af tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:37.326237 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-507b5711-bbf7-4591-ab76-6336303328af tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1515 microversion: 2.1 time: 0.213353 Oct 28 12:15:37.326855 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 207/453] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:37 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1515 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:37.966966 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b26a6d56-5905-4aa6-9e88-765c509a13cb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:37.968614 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b26a6d56-5905-4aa6-9e88-765c509a13cb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:37.976702 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b26a6d56-5905-4aa6-9e88-765c509a13cb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:37.977146 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b26a6d56-5905-4aa6-9e88-765c509a13cb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:37.978129 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b26a6d56-5905-4aa6-9e88-765c509a13cb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:37.978767 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b26a6d56-5905-4aa6-9e88-765c509a13cb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:38.041874 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-50a64c37-2f4d-422c-8f2e-ba9aec15d5a1 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Action: 'create', calling method: .version_select at 0x7f11f2f2ed30>, body: {"keypair": {"name": "tempest-TestShelveInstance-669426014"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:38.049330 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b26a6d56-5905-4aa6-9e88-765c509a13cb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.085891 Oct 28 12:15:38.053261 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 208/454] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:37 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:15:38.061133 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-50a64c37-2f4d-422c-8f2e-ba9aec15d5a1 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Getting quotas for project a714ee6cfd984bbf823ab5c422c5a3eb. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:15:38.065010 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-50a64c37-2f4d-422c-8f2e-ba9aec15d5a1 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Getting quotas for user 6695129614aa49dc9fcc1e1b27083b98 and project a714ee6cfd984bbf823ab5c422c5a3eb. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:15:38.079910 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5dc5d1fb-f24a-470a-92a4-22083fd4e0bd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:38.080607 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5dc5d1fb-f24a-470a-92a4-22083fd4e0bd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:38.087196 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5dc5d1fb-f24a-470a-92a4-22083fd4e0bd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:38.087825 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5dc5d1fb-f24a-470a-92a4-22083fd4e0bd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:38.088758 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5dc5d1fb-f24a-470a-92a4-22083fd4e0bd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:38.089879 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5dc5d1fb-f24a-470a-92a4-22083fd4e0bd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:38.223951 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5dc5d1fb-f24a-470a-92a4-22083fd4e0bd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:38.232955 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5dc5d1fb-f24a-470a-92a4-22083fd4e0bd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1507 microversion: 2.1 time: 0.157407 Oct 28 12:15:38.233503 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 209/455] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:38 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:38.425617 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-50a64c37-2f4d-422c-8f2e-ba9aec15d5a1 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Getting quotas for project a714ee6cfd984bbf823ab5c422c5a3eb. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:15:38.430050 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-50a64c37-2f4d-422c-8f2e-ba9aec15d5a1 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Getting quotas for user 6695129614aa49dc9fcc1e1b27083b98 and project a714ee6cfd984bbf823ab5c422c5a3eb. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:15:38.451808 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-50a64c37-2f4d-422c-8f2e-ba9aec15d5a1 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.624817 Oct 28 12:15:38.452614 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 247/456] 10.222.0.37 () {60 vars in 1157 bytes} [Thu Oct 28 12:15:37 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:39.060330 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0f6c64b1-cfec-47ce-a2bd-d2249215655b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:39.061397 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0f6c64b1-cfec-47ce-a2bd-d2249215655b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:39.067969 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f6c64b1-cfec-47ce-a2bd-d2249215655b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:39.068483 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f6c64b1-cfec-47ce-a2bd-d2249215655b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:39.069419 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f6c64b1-cfec-47ce-a2bd-d2249215655b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:39.069843 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f6c64b1-cfec-47ce-a2bd-d2249215655b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:39.149721 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0f6c64b1-cfec-47ce-a2bd-d2249215655b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.093278 Oct 28 12:15:39.155193 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 210/457] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:39 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:15:40.162603 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-40adc77a-19ca-4ae1-8332-dbef3a8683c6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:40.163529 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-40adc77a-19ca-4ae1-8332-dbef3a8683c6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:40.174611 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-40adc77a-19ca-4ae1-8332-dbef3a8683c6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:40.175085 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-40adc77a-19ca-4ae1-8332-dbef3a8683c6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:40.175839 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-40adc77a-19ca-4ae1-8332-dbef3a8683c6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:40.176269 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-40adc77a-19ca-4ae1-8332-dbef3a8683c6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:40.302365 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-40adc77a-19ca-4ae1-8332-dbef3a8683c6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.143969 Oct 28 12:15:40.304009 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 248/458] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:40 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:15:41.315842 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0ec67d05-0d17-4a7b-a25d-7cacae169cf8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:41.316963 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0ec67d05-0d17-4a7b-a25d-7cacae169cf8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:41.324742 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0ec67d05-0d17-4a7b-a25d-7cacae169cf8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:41.325187 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0ec67d05-0d17-4a7b-a25d-7cacae169cf8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:41.326015 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0ec67d05-0d17-4a7b-a25d-7cacae169cf8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:41.326406 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0ec67d05-0d17-4a7b-a25d-7cacae169cf8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:41.392280 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0ec67d05-0d17-4a7b-a25d-7cacae169cf8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.080332 Oct 28 12:15:41.392919 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 211/459] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:41 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:15:42.404032 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ea2b9c73-3afc-4ab6-8759-2076b7e6ecf8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:42.404937 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ea2b9c73-3afc-4ab6-8759-2076b7e6ecf8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:42.412135 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ea2b9c73-3afc-4ab6-8759-2076b7e6ecf8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:42.412625 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ea2b9c73-3afc-4ab6-8759-2076b7e6ecf8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:42.413405 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ea2b9c73-3afc-4ab6-8759-2076b7e6ecf8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:42.413867 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ea2b9c73-3afc-4ab6-8759-2076b7e6ecf8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:42.535283 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ea2b9c73-3afc-4ab6-8759-2076b7e6ecf8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28190 microversion: 2.20 time: 0.134972 Oct 28 12:15:42.535967 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 249/460] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:42 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28190 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:15:43.150734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3146ada9-5ce2-4962-a9c8-ca5a54be58b9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:43.151417 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3146ada9-5ce2-4962-a9c8-ca5a54be58b9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:43.158879 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3146ada9-5ce2-4962-a9c8-ca5a54be58b9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:43.159315 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3146ada9-5ce2-4962-a9c8-ca5a54be58b9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:43.160058 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3146ada9-5ce2-4962-a9c8-ca5a54be58b9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:43.160481 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3146ada9-5ce2-4962-a9c8-ca5a54be58b9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:43.289100 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3146ada9-5ce2-4962-a9c8-ca5a54be58b9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:43.297010 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3146ada9-5ce2-4962-a9c8-ca5a54be58b9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1515 microversion: 2.1 time: 0.150268 Oct 28 12:15:43.297566 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 212/461] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:43 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:43.313887 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0db34839-9569-47db-921f-3785b3bdaa42 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0248aef7-1fd1-4086-b111-4c3653f15fa9"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:43.315043 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0db34839-9569-47db-921f-3785b3bdaa42 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:43.321677 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0db34839-9569-47db-921f-3785b3bdaa42 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:43.322124 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0db34839-9569-47db-921f-3785b3bdaa42 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:43.322907 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0db34839-9569-47db-921f-3785b3bdaa42 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:43.323343 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0db34839-9569-47db-921f-3785b3bdaa42 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:43.547852 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bc026be5-bb16-464f-8d6c-e981af56fd80 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:43.548771 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bc026be5-bb16-464f-8d6c-e981af56fd80 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:43.555174 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc026be5-bb16-464f-8d6c-e981af56fd80 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:43.555615 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc026be5-bb16-464f-8d6c-e981af56fd80 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:43.556385 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc026be5-bb16-464f-8d6c-e981af56fd80 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:43.556842 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc026be5-bb16-464f-8d6c-e981af56fd80 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:43.575344 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0db34839-9569-47db-921f-3785b3bdaa42 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "POST /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265224 Oct 28 12:15:43.576737 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 250/462] 10.222.0.37 () {60 vars in 1322 bytes} [Thu Oct 28 12:15:43 2021] POST /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:15:43.667870 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bc026be5-bb16-464f-8d6c-e981af56fd80 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28481 microversion: 2.20 time: 0.123499 Oct 28 12:15:43.668595 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 213/463] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:43 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28481 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:15:43.797654 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e058c180-a205-42ab-b8ab-f435d00f6d47 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef63fcc9-945f-4781-a2d9-8df98c0191fe"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:43.798822 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e058c180-a205-42ab-b8ab-f435d00f6d47 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:43.804832 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e058c180-a205-42ab-b8ab-f435d00f6d47 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:43.805275 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e058c180-a205-42ab-b8ab-f435d00f6d47 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:43.806110 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e058c180-a205-42ab-b8ab-f435d00f6d47 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:43.806543 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e058c180-a205-42ab-b8ab-f435d00f6d47 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:44.071233 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e058c180-a205-42ab-b8ab-f435d00f6d47 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "POST /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278437 Oct 28 12:15:44.072064 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 251/464] 10.222.0.37 () {60 vars in 1322 bytes} [Thu Oct 28 12:15:43 2021] POST /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:15:44.680969 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-66a1371e-b03b-46bf-8e8f-c26c5972a412 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:44.681966 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-66a1371e-b03b-46bf-8e8f-c26c5972a412 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:44.688856 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66a1371e-b03b-46bf-8e8f-c26c5972a412 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:44.689528 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66a1371e-b03b-46bf-8e8f-c26c5972a412 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:44.690062 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66a1371e-b03b-46bf-8e8f-c26c5972a412 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:44.690499 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-66a1371e-b03b-46bf-8e8f-c26c5972a412 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:44.769232 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-66a1371e-b03b-46bf-8e8f-c26c5972a412 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28481 microversion: 2.20 time: 0.092302 Oct 28 12:15:44.770076 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 214/465] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:44 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28481 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:15:45.788209 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a67293c1-ee9d-43ef-9786-eb0d447dbcfa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:45.789859 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a67293c1-ee9d-43ef-9786-eb0d447dbcfa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:45.797574 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a67293c1-ee9d-43ef-9786-eb0d447dbcfa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:45.798206 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a67293c1-ee9d-43ef-9786-eb0d447dbcfa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:45.799017 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a67293c1-ee9d-43ef-9786-eb0d447dbcfa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:45.799636 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a67293c1-ee9d-43ef-9786-eb0d447dbcfa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:45.890762 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a67293c1-ee9d-43ef-9786-eb0d447dbcfa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28481 microversion: 2.20 time: 0.111963 Oct 28 12:15:45.891424 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 252/466] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:45 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28481 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:15:46.902249 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e34d4762-529d-44f6-ae11-e3095739169d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:46.903282 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e34d4762-529d-44f6-ae11-e3095739169d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:46.909915 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e34d4762-529d-44f6-ae11-e3095739169d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:46.910367 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e34d4762-529d-44f6-ae11-e3095739169d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:46.911176 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e34d4762-529d-44f6-ae11-e3095739169d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:46.911609 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e34d4762-529d-44f6-ae11-e3095739169d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:47.009900 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e34d4762-529d-44f6-ae11-e3095739169d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.111638 Oct 28 12:15:47.014101 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 215/467] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:46 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:15:48.021963 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-da327374-e1e9-409a-8b6e-7b50387f5fcd tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:48.022986 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-da327374-e1e9-409a-8b6e-7b50387f5fcd tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:48.029790 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-da327374-e1e9-409a-8b6e-7b50387f5fcd tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:48.030294 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-da327374-e1e9-409a-8b6e-7b50387f5fcd tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:48.031603 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-da327374-e1e9-409a-8b6e-7b50387f5fcd tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:48.032421 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-da327374-e1e9-409a-8b6e-7b50387f5fcd tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:51.394862 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-da327374-e1e9-409a-8b6e-7b50387f5fcd tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 3.376794 Oct 28 12:15:51.398746 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 253/468] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:48 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 3379 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:15:52.407050 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f7c5e5e7-8f11-430a-a116-ad6db5e31d84 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:52.408039 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f7c5e5e7-8f11-430a-a116-ad6db5e31d84 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:52.415041 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f7c5e5e7-8f11-430a-a116-ad6db5e31d84 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:52.415474 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f7c5e5e7-8f11-430a-a116-ad6db5e31d84 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:52.416267 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f7c5e5e7-8f11-430a-a116-ad6db5e31d84 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:52.416666 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f7c5e5e7-8f11-430a-a116-ad6db5e31d84 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:53.364930 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f7c5e5e7-8f11-430a-a116-ad6db5e31d84 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.961515 Oct 28 12:15:53.365713 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 216/469] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:52 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:15:54.378888 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a9ae3bbb-ae1f-4aaa-b2df-ccf63b7058af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:54.379875 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a9ae3bbb-ae1f-4aaa-b2df-ccf63b7058af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:54.387417 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a9ae3bbb-ae1f-4aaa-b2df-ccf63b7058af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:54.387823 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a9ae3bbb-ae1f-4aaa-b2df-ccf63b7058af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:54.388588 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a9ae3bbb-ae1f-4aaa-b2df-ccf63b7058af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:54.389020 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a9ae3bbb-ae1f-4aaa-b2df-ccf63b7058af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:54.462097 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a9ae3bbb-ae1f-4aaa-b2df-ccf63b7058af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.087135 Oct 28 12:15:54.462795 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 254/470] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:54 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:15:55.370077 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-69c4946b-9b14-48cb-8bee-f01477540f4e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:55.371127 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-69c4946b-9b14-48cb-8bee-f01477540f4e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:55.377709 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69c4946b-9b14-48cb-8bee-f01477540f4e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:55.378154 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69c4946b-9b14-48cb-8bee-f01477540f4e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:55.379153 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69c4946b-9b14-48cb-8bee-f01477540f4e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:55.379599 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-69c4946b-9b14-48cb-8bee-f01477540f4e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:55.406479 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-69c4946b-9b14-48cb-8bee-f01477540f4e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lazy-loading 'flavor' on Instance uuid 28b1cf11-e525-409b-83da-1c26e1d9937d {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:15:55.475105 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-37668ec7-0222-4ab4-b9d9-3f04669ebe71 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:55.476160 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-37668ec7-0222-4ab4-b9d9-3f04669ebe71 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:55.493336 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-37668ec7-0222-4ab4-b9d9-3f04669ebe71 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:55.493785 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-37668ec7-0222-4ab4-b9d9-3f04669ebe71 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:55.500524 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-37668ec7-0222-4ab4-b9d9-3f04669ebe71 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:55.501017 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-37668ec7-0222-4ab4-b9d9-3f04669ebe71 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:55.556339 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-69c4946b-9b14-48cb-8bee-f01477540f4e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "POST /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/action" status: 200 len: 32 microversion: 2.1 time: 0.190126 Oct 28 12:15:55.557513 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 217/471] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:15:55 2021] POST /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/action => generated 32 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 12:15:55.569734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-690ec1bd-c461-4d94-a0c6-66300ea812cb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:55.570409 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-690ec1bd-c461-4d94-a0c6-66300ea812cb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:55.584592 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-690ec1bd-c461-4d94-a0c6-66300ea812cb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:55.585222 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-690ec1bd-c461-4d94-a0c6-66300ea812cb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:55.586272 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-690ec1bd-c461-4d94-a0c6-66300ea812cb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:55.586842 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-690ec1bd-c461-4d94-a0c6-66300ea812cb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:55.590589 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-37668ec7-0222-4ab4-b9d9-3f04669ebe71 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.119528 Oct 28 12:15:55.591550 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 255/472] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:55 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:15:55.764886 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-690ec1bd-c461-4d94-a0c6-66300ea812cb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:55.772891 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-690ec1bd-c461-4d94-a0c6-66300ea812cb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.208754 Oct 28 12:15:55.773451 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 218/473] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:55 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:15:56.601769 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-27c84043-5232-4508-a2d1-562724a302f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:15:56.602853 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-27c84043-5232-4508-a2d1-562724a302f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:56.610195 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-27c84043-5232-4508-a2d1-562724a302f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:56.610632 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-27c84043-5232-4508-a2d1-562724a302f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:56.611411 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-27c84043-5232-4508-a2d1-562724a302f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:56.611831 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-27c84043-5232-4508-a2d1-562724a302f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:56.789836 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d9dcea91-1c03-43ba-afb3-1d8a684db5ed tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:56.790508 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d9dcea91-1c03-43ba-afb3-1d8a684db5ed tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:56.797866 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9dcea91-1c03-43ba-afb3-1d8a684db5ed tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:56.798349 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9dcea91-1c03-43ba-afb3-1d8a684db5ed tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:56.799143 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9dcea91-1c03-43ba-afb3-1d8a684db5ed tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:56.799573 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9dcea91-1c03-43ba-afb3-1d8a684db5ed tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:56.937772 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d9dcea91-1c03-43ba-afb3-1d8a684db5ed tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:56.946112 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d9dcea91-1c03-43ba-afb3-1d8a684db5ed tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.159801 Oct 28 12:15:56.946713 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 219/474] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:56 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:57.963194 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0144f87f-e20d-42a3-9fb0-7e637dcfe4b4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:57.963859 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0144f87f-e20d-42a3-9fb0-7e637dcfe4b4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:57.970887 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0144f87f-e20d-42a3-9fb0-7e637dcfe4b4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:57.971349 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0144f87f-e20d-42a3-9fb0-7e637dcfe4b4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:57.972156 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0144f87f-e20d-42a3-9fb0-7e637dcfe4b4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:57.972571 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0144f87f-e20d-42a3-9fb0-7e637dcfe4b4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:58.163457 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0144f87f-e20d-42a3-9fb0-7e637dcfe4b4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:58.173441 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0144f87f-e20d-42a3-9fb0-7e637dcfe4b4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.213632 Oct 28 12:15:58.174294 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 220/475] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:57 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:15:59.190400 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5a37ba9e-7685-4a91-9ce3-a79c2a52bd16 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:15:59.191062 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5a37ba9e-7685-4a91-9ce3-a79c2a52bd16 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:15:59.197087 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5a37ba9e-7685-4a91-9ce3-a79c2a52bd16 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:59.197576 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5a37ba9e-7685-4a91-9ce3-a79c2a52bd16 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:59.198455 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5a37ba9e-7685-4a91-9ce3-a79c2a52bd16 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:15:59.198930 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5a37ba9e-7685-4a91-9ce3-a79c2a52bd16 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:15:59.341122 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5a37ba9e-7685-4a91-9ce3-a79c2a52bd16 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:15:59.351460 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5a37ba9e-7685-4a91-9ce3-a79c2a52bd16 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.164332 Oct 28 12:15:59.352108 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 221/476] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:15:59 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:00.368266 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d14577fd-9623-422e-b2cf-4d5c989a710e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:00.368874 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d14577fd-9623-422e-b2cf-4d5c989a710e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:00.375661 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d14577fd-9623-422e-b2cf-4d5c989a710e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:00.376101 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d14577fd-9623-422e-b2cf-4d5c989a710e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:00.376856 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d14577fd-9623-422e-b2cf-4d5c989a710e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:00.377285 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d14577fd-9623-422e-b2cf-4d5c989a710e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:00.498887 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d14577fd-9623-422e-b2cf-4d5c989a710e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:00.506515 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d14577fd-9623-422e-b2cf-4d5c989a710e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.141973 Oct 28 12:16:00.507110 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 222/477] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:00 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:00.877365 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-27c84043-5232-4508-a2d1-562724a302f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 4.279365 Oct 28 12:16:00.878027 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 256/478] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:15:56 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 4281 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:01.523435 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d06c741b-74e4-4656-bfd6-c2e07236f015 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:01.524063 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d06c741b-74e4-4656-bfd6-c2e07236f015 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:01.530789 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d06c741b-74e4-4656-bfd6-c2e07236f015 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:01.531234 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d06c741b-74e4-4656-bfd6-c2e07236f015 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:01.531988 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d06c741b-74e4-4656-bfd6-c2e07236f015 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:01.532417 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d06c741b-74e4-4656-bfd6-c2e07236f015 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:01.653775 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d06c741b-74e4-4656-bfd6-c2e07236f015 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:01.662053 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d06c741b-74e4-4656-bfd6-c2e07236f015 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.142304 Oct 28 12:16:01.662608 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 223/479] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:01 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:01.889227 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c106cf64-24e7-488c-becf-08cfa1bf8c61 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:01.890205 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c106cf64-24e7-488c-becf-08cfa1bf8c61 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:01.898253 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c106cf64-24e7-488c-becf-08cfa1bf8c61 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:01.898762 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c106cf64-24e7-488c-becf-08cfa1bf8c61 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:01.899608 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c106cf64-24e7-488c-becf-08cfa1bf8c61 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:01.900143 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c106cf64-24e7-488c-becf-08cfa1bf8c61 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:01.977405 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c106cf64-24e7-488c-becf-08cfa1bf8c61 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.092161 Oct 28 12:16:01.978301 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 257/480] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:01 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:02.678606 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-71de1793-ce2d-45bf-b984-d7d189226eab tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:02.679241 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-71de1793-ce2d-45bf-b984-d7d189226eab tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:02.686189 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-71de1793-ce2d-45bf-b984-d7d189226eab tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:02.686628 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-71de1793-ce2d-45bf-b984-d7d189226eab tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:02.687434 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-71de1793-ce2d-45bf-b984-d7d189226eab tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:02.687862 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-71de1793-ce2d-45bf-b984-d7d189226eab tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:02.821229 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-71de1793-ce2d-45bf-b984-d7d189226eab tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:02.824695 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-71de1793-ce2d-45bf-b984-d7d189226eab tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.149634 Oct 28 12:16:02.825289 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 224/481] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:02 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:02.989034 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-40532e8e-b6f2-4d00-a817-b819559e0959 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:02.989986 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-40532e8e-b6f2-4d00-a817-b819559e0959 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:02.996743 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-40532e8e-b6f2-4d00-a817-b819559e0959 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:02.997182 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-40532e8e-b6f2-4d00-a817-b819559e0959 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:02.998588 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-40532e8e-b6f2-4d00-a817-b819559e0959 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:02.999072 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-40532e8e-b6f2-4d00-a817-b819559e0959 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:03.154112 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a7afe801-c2b5-45b0-988c-f12b5ee5c3c6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef63fcc9-945f-4781-a2d9-8df98c0191fe"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:03.155259 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a7afe801-c2b5-45b0-988c-f12b5ee5c3c6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:03.160887 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a7afe801-c2b5-45b0-988c-f12b5ee5c3c6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:03.161326 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a7afe801-c2b5-45b0-988c-f12b5ee5c3c6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:03.162086 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a7afe801-c2b5-45b0-988c-f12b5ee5c3c6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:03.162509 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a7afe801-c2b5-45b0-988c-f12b5ee5c3c6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:03.236816 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-a7afe801-c2b5-45b0-988c-f12b5ee5c3c6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] HTTP exception thrown: Invalid volume: volume ef63fcc9-945f-4781-a2d9-8df98c0191fe is already attached to instances: 948c9fed-b55d-4b55-9971-f4db721088aa Oct 28 12:16:03.237342 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a7afe801-c2b5-45b0-988c-f12b5ee5c3c6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Returning 400 to user: Invalid volume: volume ef63fcc9-945f-4781-a2d9-8df98c0191fe is already attached to instances: 948c9fed-b55d-4b55-9971-f4db721088aa {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:16:03.238156 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a7afe801-c2b5-45b0-988c-f12b5ee5c3c6 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "POST /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.087889 Oct 28 12:16:03.238710 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 225/482] 10.222.0.37 () {60 vars in 1322 bytes} [Thu Oct 28 12:16:03 2021] POST /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments => generated 174 bytes in 89 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 12:16:03.293972 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ec804a04-43a8-4073-8b2f-4b51ac1baa03 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:03.294455 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ec804a04-43a8-4073-8b2f-4b51ac1baa03 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:03.300968 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ec804a04-43a8-4073-8b2f-4b51ac1baa03 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:03.301406 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ec804a04-43a8-4073-8b2f-4b51ac1baa03 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:03.302157 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ec804a04-43a8-4073-8b2f-4b51ac1baa03 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:03.302585 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ec804a04-43a8-4073-8b2f-4b51ac1baa03 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:03.427038 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-ec804a04-43a8-4073-8b2f-4b51ac1baa03 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lazy-loading 'services' on Instance uuid 948c9fed-b55d-4b55-9971-f4db721088aa {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:16:03.543473 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ec804a04-43a8-4073-8b2f-4b51ac1baa03 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "DELETE /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments/ef63fcc9-945f-4781-a2d9-8df98c0191fe" status: 202 len: 0 microversion: 2.1 time: 0.253117 Oct 28 12:16:03.544051 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 226/483] 10.222.0.37 () {58 vars in 1415 bytes} [Thu Oct 28 12:16:03 2021] DELETE /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments/ef63fcc9-945f-4781-a2d9-8df98c0191fe => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:16:03.553076 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f0ec92a0-7197-4cc0-b31b-07fb750852c2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:03.554056 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f0ec92a0-7197-4cc0-b31b-07fb750852c2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:03.560017 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f0ec92a0-7197-4cc0-b31b-07fb750852c2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:03.560472 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f0ec92a0-7197-4cc0-b31b-07fb750852c2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:03.561228 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f0ec92a0-7197-4cc0-b31b-07fb750852c2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:03.561660 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f0ec92a0-7197-4cc0-b31b-07fb750852c2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:03.592122 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f0ec92a0-7197-4cc0-b31b-07fb750852c2 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042279 Oct 28 12:16:03.592672 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 227/484] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:16:03 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:16:03.844830 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8b939db1-df3a-401c-abcf-83f195957aa6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:03.845433 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8b939db1-df3a-401c-abcf-83f195957aa6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:03.851614 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b939db1-df3a-401c-abcf-83f195957aa6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:03.852059 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b939db1-df3a-401c-abcf-83f195957aa6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:03.852821 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b939db1-df3a-401c-abcf-83f195957aa6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:03.853253 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b939db1-df3a-401c-abcf-83f195957aa6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:03.974106 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8b939db1-df3a-401c-abcf-83f195957aa6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:03.981805 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8b939db1-df3a-401c-abcf-83f195957aa6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.141231 Oct 28 12:16:03.982889 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 228/485] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:03 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:04.603611 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6f6d0e56-97eb-4d16-84ec-2c32205cbdc8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:04.604512 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6f6d0e56-97eb-4d16-84ec-2c32205cbdc8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:04.610892 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6f6d0e56-97eb-4d16-84ec-2c32205cbdc8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:04.611333 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6f6d0e56-97eb-4d16-84ec-2c32205cbdc8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:04.612090 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6f6d0e56-97eb-4d16-84ec-2c32205cbdc8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:04.612517 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6f6d0e56-97eb-4d16-84ec-2c32205cbdc8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:04.640648 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6f6d0e56-97eb-4d16-84ec-2c32205cbdc8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040784 Oct 28 12:16:04.641184 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 229/486] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:16:04 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:16:04.998581 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5864d08a-efaa-41cc-8b77-2a585ba16507 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:04.999245 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5864d08a-efaa-41cc-8b77-2a585ba16507 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:05.005342 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5864d08a-efaa-41cc-8b77-2a585ba16507 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:05.005790 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5864d08a-efaa-41cc-8b77-2a585ba16507 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:05.006553 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5864d08a-efaa-41cc-8b77-2a585ba16507 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:05.007045 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5864d08a-efaa-41cc-8b77-2a585ba16507 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:05.125379 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5864d08a-efaa-41cc-8b77-2a585ba16507 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:05.132956 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5864d08a-efaa-41cc-8b77-2a585ba16507 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.137934 Oct 28 12:16:05.133521 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 230/487] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:04 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:05.651866 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-efb090a1-d84d-47b8-88aa-b75f4f2b7dbc tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:05.652910 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-efb090a1-d84d-47b8-88aa-b75f4f2b7dbc tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:05.659480 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-efb090a1-d84d-47b8-88aa-b75f4f2b7dbc tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:05.659922 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-efb090a1-d84d-47b8-88aa-b75f4f2b7dbc tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:05.660669 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-efb090a1-d84d-47b8-88aa-b75f4f2b7dbc tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:05.661130 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-efb090a1-d84d-47b8-88aa-b75f4f2b7dbc tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:05.689663 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-efb090a1-d84d-47b8-88aa-b75f4f2b7dbc tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041550 Oct 28 12:16:05.690203 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 231/488] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:16:05 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:16:06.149734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0f139779-ae1f-418a-a453-bf9db61794ef tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:06.150324 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0f139779-ae1f-418a-a453-bf9db61794ef tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:06.156578 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f139779-ae1f-418a-a453-bf9db61794ef tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:06.157018 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f139779-ae1f-418a-a453-bf9db61794ef tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:06.157769 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f139779-ae1f-418a-a453-bf9db61794ef tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:06.158193 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0f139779-ae1f-418a-a453-bf9db61794ef tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:06.281141 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0f139779-ae1f-418a-a453-bf9db61794ef tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:06.288923 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0f139779-ae1f-418a-a453-bf9db61794ef tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.142818 Oct 28 12:16:06.289479 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 232/489] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:06 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:06.700959 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fea0f3c5-7685-4f97-905d-d64b33cc36a1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:06.701846 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fea0f3c5-7685-4f97-905d-d64b33cc36a1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:06.707594 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fea0f3c5-7685-4f97-905d-d64b33cc36a1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:06.708028 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fea0f3c5-7685-4f97-905d-d64b33cc36a1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:06.708774 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fea0f3c5-7685-4f97-905d-d64b33cc36a1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:06.709194 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fea0f3c5-7685-4f97-905d-d64b33cc36a1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:06.738157 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fea0f3c5-7685-4f97-905d-d64b33cc36a1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040997 Oct 28 12:16:06.738619 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 233/490] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:16:06 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:16:07.142429 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-40532e8e-b6f2-4d00-a817-b819559e0959 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 4.157329 Oct 28 12:16:07.143166 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 258/491] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:02 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 4159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:07.306705 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-663f6976-357e-4b4e-8388-d870a50713c2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:07.307160 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-663f6976-357e-4b4e-8388-d870a50713c2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:07.313528 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-663f6976-357e-4b4e-8388-d870a50713c2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:07.313962 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-663f6976-357e-4b4e-8388-d870a50713c2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:07.314726 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-663f6976-357e-4b4e-8388-d870a50713c2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:07.315160 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-663f6976-357e-4b4e-8388-d870a50713c2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:07.435078 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-663f6976-357e-4b4e-8388-d870a50713c2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:07.443139 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-663f6976-357e-4b4e-8388-d870a50713c2 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.140630 Oct 28 12:16:07.443697 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 234/492] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:07 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:07.750446 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ae9da9da-5b96-4eb1-a710-460e6aabab82 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:07.752127 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ae9da9da-5b96-4eb1-a710-460e6aabab82 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:07.759025 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ae9da9da-5b96-4eb1-a710-460e6aabab82 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:07.759494 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ae9da9da-5b96-4eb1-a710-460e6aabab82 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:07.760311 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ae9da9da-5b96-4eb1-a710-460e6aabab82 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:07.760736 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ae9da9da-5b96-4eb1-a710-460e6aabab82 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:07.788791 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ae9da9da-5b96-4eb1-a710-460e6aabab82 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043135 Oct 28 12:16:07.789326 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 259/493] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:16:07 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:16:08.153836 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-565511f2-d312-43a5-9a44-097a23a5ae67 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:08.154804 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-565511f2-d312-43a5-9a44-097a23a5ae67 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:08.160586 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-565511f2-d312-43a5-9a44-097a23a5ae67 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:08.161028 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-565511f2-d312-43a5-9a44-097a23a5ae67 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:08.161784 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-565511f2-d312-43a5-9a44-097a23a5ae67 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:08.162211 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-565511f2-d312-43a5-9a44-097a23a5ae67 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:08.359135 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-565511f2-d312-43a5-9a44-097a23a5ae67 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.208678 Oct 28 12:16:08.359880 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 235/494] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:08 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:08.459973 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-08225cd6-6dcd-4840-baad-4dd20caddb21 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:08.460516 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-08225cd6-6dcd-4840-baad-4dd20caddb21 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:08.466812 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-08225cd6-6dcd-4840-baad-4dd20caddb21 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:08.467227 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-08225cd6-6dcd-4840-baad-4dd20caddb21 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:08.468050 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-08225cd6-6dcd-4840-baad-4dd20caddb21 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:08.468485 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-08225cd6-6dcd-4840-baad-4dd20caddb21 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:08.587766 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-08225cd6-6dcd-4840-baad-4dd20caddb21 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:08.595544 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-08225cd6-6dcd-4840-baad-4dd20caddb21 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.139255 Oct 28 12:16:08.596121 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 260/495] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:08 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:08.801876 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e0adb03b-1c8b-4775-a641-9f3ccf031d16 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:08.802934 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e0adb03b-1c8b-4775-a641-9f3ccf031d16 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:08.809601 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e0adb03b-1c8b-4775-a641-9f3ccf031d16 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:08.810064 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e0adb03b-1c8b-4775-a641-9f3ccf031d16 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:08.810844 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e0adb03b-1c8b-4775-a641-9f3ccf031d16 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:08.811279 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e0adb03b-1c8b-4775-a641-9f3ccf031d16 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:08.839784 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e0adb03b-1c8b-4775-a641-9f3ccf031d16 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042220 Oct 28 12:16:08.840318 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 236/496] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:16:08 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:16:09.370935 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-10290446-61cc-417b-8b57-e9c5d5889d79 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:09.371937 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-10290446-61cc-417b-8b57-e9c5d5889d79 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:09.378839 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-10290446-61cc-417b-8b57-e9c5d5889d79 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:09.379288 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-10290446-61cc-417b-8b57-e9c5d5889d79 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:09.380050 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-10290446-61cc-417b-8b57-e9c5d5889d79 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:09.380476 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-10290446-61cc-417b-8b57-e9c5d5889d79 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:09.457909 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-10290446-61cc-417b-8b57-e9c5d5889d79 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.090541 Oct 28 12:16:09.461969 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 261/497] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:09 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:09.613315 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4047ba32-fe27-439b-8bc1-e93b8a1f9090 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:09.614001 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4047ba32-fe27-439b-8bc1-e93b8a1f9090 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:09.620345 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4047ba32-fe27-439b-8bc1-e93b8a1f9090 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:09.621032 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4047ba32-fe27-439b-8bc1-e93b8a1f9090 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:09.621801 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4047ba32-fe27-439b-8bc1-e93b8a1f9090 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:09.622218 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4047ba32-fe27-439b-8bc1-e93b8a1f9090 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:09.751963 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4047ba32-fe27-439b-8bc1-e93b8a1f9090 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:09.759863 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4047ba32-fe27-439b-8bc1-e93b8a1f9090 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.152022 Oct 28 12:16:09.760422 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 237/498] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:09 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:09.852899 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c314c645-5d51-4c77-b467-7fad997b5065 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:09.853920 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c314c645-5d51-4c77-b467-7fad997b5065 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:09.861332 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c314c645-5d51-4c77-b467-7fad997b5065 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:09.861781 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c314c645-5d51-4c77-b467-7fad997b5065 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:09.862560 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c314c645-5d51-4c77-b467-7fad997b5065 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:09.863023 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c314c645-5d51-4c77-b467-7fad997b5065 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:09.899671 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c314c645-5d51-4c77-b467-7fad997b5065 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051523 Oct 28 12:16:09.900266 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 262/499] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:16:09 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:16:10.057114 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-543b60c6-6df3-4c19-8558-35eb090a0749 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1847767583", "imageRef": "4385a199-a3e9-4c11-b580-60e7a24d0e97", "flavorRef": "452", "networks": [{"uuid": "6473d7e8-f419-4ba9-aecd-de2094cc6dd8"}]}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:10.121139 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-543b60c6-6df3-4c19-8558-35eb090a0749 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] validate_networks() for [('6473d7e8-f419-4ba9-aecd-de2094cc6dd8', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:16:10.472161 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-96cae6ba-ad75-433c-ba2f-fd337e6b3e12 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:10.473066 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-96cae6ba-ad75-433c-ba2f-fd337e6b3e12 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:10.479876 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96cae6ba-ad75-433c-ba2f-fd337e6b3e12 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:10.480324 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96cae6ba-ad75-433c-ba2f-fd337e6b3e12 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:10.481197 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96cae6ba-ad75-433c-ba2f-fd337e6b3e12 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:10.481705 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96cae6ba-ad75-433c-ba2f-fd337e6b3e12 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:10.492255 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-543b60c6-6df3-4c19-8558-35eb090a0749 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:16:10.492677 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-543b60c6-6df3-4c19-8558-35eb090a0749 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:16:10.493151 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-543b60c6-6df3-4c19-8558-35eb090a0749 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:16:10.493571 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-543b60c6-6df3-4c19-8558-35eb090a0749 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:16:10.493974 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-543b60c6-6df3-4c19-8558-35eb090a0749 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:16:10.503439 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-543b60c6-6df3-4c19-8558-35eb090a0749 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:10.503991 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-543b60c6-6df3-4c19-8558-35eb090a0749 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:10.504904 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-543b60c6-6df3-4c19-8558-35eb090a0749 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:10.505480 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-543b60c6-6df3-4c19-8558-35eb090a0749 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:10.523074 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-543b60c6-6df3-4c19-8558-35eb090a0749 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Getting quotas for project f032353009b64d738b6c00574846cb51. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:16:10.527051 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-543b60c6-6df3-4c19-8558-35eb090a0749 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Getting quotas for user 27f6b74ea1274a9bba153118ccf63571 and project f032353009b64d738b6c00574846cb51. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:16:10.538638 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-543b60c6-6df3-4c19-8558-35eb090a0749 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:16:10.541361 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-543b60c6-6df3-4c19-8558-35eb090a0749 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4385a199-a3e9-4c11-b580-60e7a24d0e97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:16:10.588646 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-543b60c6-6df3-4c19-8558-35eb090a0749 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535066 Oct 28 12:16:10.589393 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 238/500] 10.222.0.37 () {60 vars in 1146 bytes} [Thu Oct 28 12:16:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:16:10.598777 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-47952eb0-fd68-4b63-9a95-74308b16b8d5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:10.599383 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-47952eb0-fd68-4b63-9a95-74308b16b8d5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:10.652694 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-47952eb0-fd68-4b63-9a95-74308b16b8d5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:10.659894 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-47952eb0-fd68-4b63-9a95-74308b16b8d5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1218 microversion: 2.1 time: 0.064766 Oct 28 12:16:10.660679 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 239/501] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:10 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:10.776447 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8b868880-a409-4a1d-8f1b-29003582fab0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:10.777095 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8b868880-a409-4a1d-8f1b-29003582fab0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:10.785909 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b868880-a409-4a1d-8f1b-29003582fab0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:10.787708 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b868880-a409-4a1d-8f1b-29003582fab0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:10.788908 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b868880-a409-4a1d-8f1b-29003582fab0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:10.789632 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b868880-a409-4a1d-8f1b-29003582fab0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:10.950258 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8b868880-a409-4a1d-8f1b-29003582fab0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:10.959399 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8b868880-a409-4a1d-8f1b-29003582fab0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.186421 Oct 28 12:16:10.960645 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 240/502] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:10 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:11.677284 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c60b1b71-9fe9-45d5-8a44-f8f89d66fa62 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:11.677948 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c60b1b71-9fe9-45d5-8a44-f8f89d66fa62 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:11.683646 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c60b1b71-9fe9-45d5-8a44-f8f89d66fa62 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:11.684087 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c60b1b71-9fe9-45d5-8a44-f8f89d66fa62 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:11.684837 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c60b1b71-9fe9-45d5-8a44-f8f89d66fa62 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:11.685270 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c60b1b71-9fe9-45d5-8a44-f8f89d66fa62 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:11.744932 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c60b1b71-9fe9-45d5-8a44-f8f89d66fa62 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:11.752163 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c60b1b71-9fe9-45d5-8a44-f8f89d66fa62 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1222 microversion: 2.1 time: 0.078381 Oct 28 12:16:11.752708 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 241/503] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:11 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:11.976725 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2bf47c1d-b762-4860-81b7-1907f600bd29 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:11.977328 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2bf47c1d-b762-4860-81b7-1907f600bd29 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:11.985111 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2bf47c1d-b762-4860-81b7-1907f600bd29 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:11.985633 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2bf47c1d-b762-4860-81b7-1907f600bd29 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:11.986530 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2bf47c1d-b762-4860-81b7-1907f600bd29 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:11.986982 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2bf47c1d-b762-4860-81b7-1907f600bd29 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:12.108734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2bf47c1d-b762-4860-81b7-1907f600bd29 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:12.116598 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2bf47c1d-b762-4860-81b7-1907f600bd29 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.143431 Oct 28 12:16:12.117181 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 242/504] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:11 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:12.769292 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-95eb7589-2cb4-4951-8734-51141122572e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:12.769980 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-95eb7589-2cb4-4951-8734-51141122572e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:12.776124 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-95eb7589-2cb4-4951-8734-51141122572e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:12.776651 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-95eb7589-2cb4-4951-8734-51141122572e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:12.777538 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-95eb7589-2cb4-4951-8734-51141122572e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:12.778074 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-95eb7589-2cb4-4951-8734-51141122572e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:12.845536 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-95eb7589-2cb4-4951-8734-51141122572e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:12.853235 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-95eb7589-2cb4-4951-8734-51141122572e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1222 microversion: 2.1 time: 0.087732 Oct 28 12:16:12.854045 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 243/505] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:12 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:13.134195 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8a79f264-2055-4358-a81a-6a45afc2ff63 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:13.134815 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8a79f264-2055-4358-a81a-6a45afc2ff63 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:13.141488 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a79f264-2055-4358-a81a-6a45afc2ff63 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:13.141929 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a79f264-2055-4358-a81a-6a45afc2ff63 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:13.142706 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a79f264-2055-4358-a81a-6a45afc2ff63 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:13.143137 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a79f264-2055-4358-a81a-6a45afc2ff63 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:13.271601 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8a79f264-2055-4358-a81a-6a45afc2ff63 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:13.280326 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8a79f264-2055-4358-a81a-6a45afc2ff63 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.150099 Oct 28 12:16:13.281342 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 244/506] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:13 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:13.870754 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-758dc15f-2a86-4176-907a-9db60f1baccb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:13.871464 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-758dc15f-2a86-4176-907a-9db60f1baccb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:13.877934 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-758dc15f-2a86-4176-907a-9db60f1baccb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:13.878377 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-758dc15f-2a86-4176-907a-9db60f1baccb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:13.879160 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-758dc15f-2a86-4176-907a-9db60f1baccb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:13.879591 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-758dc15f-2a86-4176-907a-9db60f1baccb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:13.938499 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-758dc15f-2a86-4176-907a-9db60f1baccb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:13.945824 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-758dc15f-2a86-4176-907a-9db60f1baccb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1222 microversion: 2.1 time: 0.078878 Oct 28 12:16:13.946390 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 245/507] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:13 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:14.297871 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fe0d839e-73fc-4639-a6c4-217ac5fa7905 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:14.298467 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fe0d839e-73fc-4639-a6c4-217ac5fa7905 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:14.304520 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe0d839e-73fc-4639-a6c4-217ac5fa7905 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:14.304955 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe0d839e-73fc-4639-a6c4-217ac5fa7905 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:14.305701 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe0d839e-73fc-4639-a6c4-217ac5fa7905 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:14.306124 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe0d839e-73fc-4639-a6c4-217ac5fa7905 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:14.423421 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fe0d839e-73fc-4639-a6c4-217ac5fa7905 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:14.430844 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fe0d839e-73fc-4639-a6c4-217ac5fa7905 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.137405 Oct 28 12:16:14.431529 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 246/508] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:14 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:14.963232 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8ec4b9c0-c252-47ab-ba15-4e7dc482ff22 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:14.963868 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8ec4b9c0-c252-47ab-ba15-4e7dc482ff22 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:14.971450 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ec4b9c0-c252-47ab-ba15-4e7dc482ff22 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:14.971894 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ec4b9c0-c252-47ab-ba15-4e7dc482ff22 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:14.972923 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ec4b9c0-c252-47ab-ba15-4e7dc482ff22 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:14.973350 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ec4b9c0-c252-47ab-ba15-4e7dc482ff22 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:15.038790 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8ec4b9c0-c252-47ab-ba15-4e7dc482ff22 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:15.046203 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8ec4b9c0-c252-47ab-ba15-4e7dc482ff22 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1222 microversion: 2.1 time: 0.086998 Oct 28 12:16:15.046782 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 247/509] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:14 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:15.448968 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8c064136-2b6d-4914-b59f-ae8432b6bf93 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:15.449679 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8c064136-2b6d-4914-b59f-ae8432b6bf93 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:15.455963 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c064136-2b6d-4914-b59f-ae8432b6bf93 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:15.456406 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c064136-2b6d-4914-b59f-ae8432b6bf93 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:15.457174 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c064136-2b6d-4914-b59f-ae8432b6bf93 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:15.457601 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c064136-2b6d-4914-b59f-ae8432b6bf93 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:15.574492 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8c064136-2b6d-4914-b59f-ae8432b6bf93 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:15.582886 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8c064136-2b6d-4914-b59f-ae8432b6bf93 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.137470 Oct 28 12:16:15.583467 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 248/510] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:15 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:16.063524 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7dc60462-bff7-415d-b5c6-78f49ae6b60c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:16.064130 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7dc60462-bff7-415d-b5c6-78f49ae6b60c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:16.069830 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7dc60462-bff7-415d-b5c6-78f49ae6b60c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:16.070276 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7dc60462-bff7-415d-b5c6-78f49ae6b60c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:16.071069 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7dc60462-bff7-415d-b5c6-78f49ae6b60c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:16.071501 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7dc60462-bff7-415d-b5c6-78f49ae6b60c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:16.129320 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7dc60462-bff7-415d-b5c6-78f49ae6b60c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:16.136333 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7dc60462-bff7-415d-b5c6-78f49ae6b60c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1222 microversion: 2.1 time: 0.077050 Oct 28 12:16:16.136894 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 249/511] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:16 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:16.423999 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-96cae6ba-ad75-433c-ba2f-fd337e6b3e12 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 5.955311 Oct 28 12:16:16.424646 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 263/512] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:10 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 5957 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:16.599664 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cb150f07-a8af-4cbc-ad68-d0f7f2bacd96 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:16.600267 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cb150f07-a8af-4cbc-ad68-d0f7f2bacd96 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:16.606765 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb150f07-a8af-4cbc-ad68-d0f7f2bacd96 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:16.607248 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb150f07-a8af-4cbc-ad68-d0f7f2bacd96 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:16.608097 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb150f07-a8af-4cbc-ad68-d0f7f2bacd96 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:16.608506 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb150f07-a8af-4cbc-ad68-d0f7f2bacd96 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:16.731458 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-cb150f07-a8af-4cbc-ad68-d0f7f2bacd96 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:16.739173 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cb150f07-a8af-4cbc-ad68-d0f7f2bacd96 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.143188 Oct 28 12:16:16.739730 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 250/513] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:16 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:17.154047 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-860fd668-4066-41b8-8190-4ee0e3f3c66b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:17.154776 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-860fd668-4066-41b8-8190-4ee0e3f3c66b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:17.162253 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-860fd668-4066-41b8-8190-4ee0e3f3c66b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:17.163380 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-860fd668-4066-41b8-8190-4ee0e3f3c66b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:17.164496 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-860fd668-4066-41b8-8190-4ee0e3f3c66b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:17.164934 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-860fd668-4066-41b8-8190-4ee0e3f3c66b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:17.240445 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-860fd668-4066-41b8-8190-4ee0e3f3c66b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:17.247725 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-860fd668-4066-41b8-8190-4ee0e3f3c66b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1278 microversion: 2.1 time: 0.097962 Oct 28 12:16:17.248821 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 264/514] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:17 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1278 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:17.438235 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bdd26a77-3126-4033-92a1-23ebf773c3c3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:17.439338 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bdd26a77-3126-4033-92a1-23ebf773c3c3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:17.445510 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bdd26a77-3126-4033-92a1-23ebf773c3c3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:17.445951 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bdd26a77-3126-4033-92a1-23ebf773c3c3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:17.446742 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bdd26a77-3126-4033-92a1-23ebf773c3c3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:17.447172 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bdd26a77-3126-4033-92a1-23ebf773c3c3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:17.544097 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bdd26a77-3126-4033-92a1-23ebf773c3c3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.111832 Oct 28 12:16:17.545413 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 251/515] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:17 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:17.755824 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c8864732-eb69-4020-a7d9-ae4409123877 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:17.757180 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c8864732-eb69-4020-a7d9-ae4409123877 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:17.765482 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8864732-eb69-4020-a7d9-ae4409123877 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:17.766055 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8864732-eb69-4020-a7d9-ae4409123877 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:17.766943 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8864732-eb69-4020-a7d9-ae4409123877 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:17.768196 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c8864732-eb69-4020-a7d9-ae4409123877 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:17.981083 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c8864732-eb69-4020-a7d9-ae4409123877 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:17.998944 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c8864732-eb69-4020-a7d9-ae4409123877 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.246268 Oct 28 12:16:18.000353 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 265/516] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:17 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:18.265888 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7c547a8d-3e2c-4c4e-a2c8-d69244cb9939 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:18.266580 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7c547a8d-3e2c-4c4e-a2c8-d69244cb9939 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:18.273333 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7c547a8d-3e2c-4c4e-a2c8-d69244cb9939 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:18.273792 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7c547a8d-3e2c-4c4e-a2c8-d69244cb9939 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:18.274635 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7c547a8d-3e2c-4c4e-a2c8-d69244cb9939 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:18.275238 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7c547a8d-3e2c-4c4e-a2c8-d69244cb9939 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:18.402136 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7c547a8d-3e2c-4c4e-a2c8-d69244cb9939 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:18.410203 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7c547a8d-3e2c-4c4e-a2c8-d69244cb9939 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1318 microversion: 2.1 time: 0.149195 Oct 28 12:16:18.410787 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 252/517] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:18 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:18.530273 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-9ad7ee52-1c4d-4fa7-99b5-78d1873e8658 req-c52099ea-6697-426e-ac1b-1095eec6c39d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da336b35-558a-46d7-a7ca-9799568bbec3", "tag": "cb078e40-acbe-40fd-aa54-76513a780403"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:18.532217 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:16:18.532217 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:16:18.540673 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-9ad7ee52-1c4d-4fa7-99b5-78d1873e8658 req-c52099ea-6697-426e-ac1b-1095eec6c39d service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:18.541316 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-9ad7ee52-1c4d-4fa7-99b5-78d1873e8658 req-c52099ea-6697-426e-ac1b-1095eec6c39d service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:18.554153 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-9ad7ee52-1c4d-4fa7-99b5-78d1873e8658 req-c52099ea-6697-426e-ac1b-1095eec6c39d service nova] Creating event network-changed:cb078e40-acbe-40fd-aa54-76513a780403 for instance da336b35-558a-46d7-a7ca-9799568bbec3 on hv-cinder-81571 Oct 28 12:16:18.556986 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-55378625-3640-47f5-9bd1-0ae7a9a4c969 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:18.558496 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-55378625-3640-47f5-9bd1-0ae7a9a4c969 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:18.558713 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-9ad7ee52-1c4d-4fa7-99b5-78d1873e8658 req-c52099ea-6697-426e-ac1b-1095eec6c39d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032613 Oct 28 12:16:18.559295 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 266/518] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:16:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:16:18.566375 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-55378625-3640-47f5-9bd1-0ae7a9a4c969 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:18.566841 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-55378625-3640-47f5-9bd1-0ae7a9a4c969 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:18.567602 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-55378625-3640-47f5-9bd1-0ae7a9a4c969 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:18.568025 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-55378625-3640-47f5-9bd1-0ae7a9a4c969 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:18.707968 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-55378625-3640-47f5-9bd1-0ae7a9a4c969 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.154675 Oct 28 12:16:18.711580 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 253/519] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:18 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:16:19.015845 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5bb15e9a-71d2-4e0e-bdbb-4776cff7b71e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:19.016664 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5bb15e9a-71d2-4e0e-bdbb-4776cff7b71e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:19.023038 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5bb15e9a-71d2-4e0e-bdbb-4776cff7b71e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:19.023597 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5bb15e9a-71d2-4e0e-bdbb-4776cff7b71e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:19.024401 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5bb15e9a-71d2-4e0e-bdbb-4776cff7b71e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:19.024854 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5bb15e9a-71d2-4e0e-bdbb-4776cff7b71e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:19.217622 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5bb15e9a-71d2-4e0e-bdbb-4776cff7b71e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:19.226248 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5bb15e9a-71d2-4e0e-bdbb-4776cff7b71e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.214401 Oct 28 12:16:19.227105 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 267/520] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:19 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:19.427892 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-74f3b0b5-ceb6-4cf9-9943-80deccf575eb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:19.428586 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-74f3b0b5-ceb6-4cf9-9943-80deccf575eb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:19.435558 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-74f3b0b5-ceb6-4cf9-9943-80deccf575eb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:19.436019 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-74f3b0b5-ceb6-4cf9-9943-80deccf575eb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:19.436815 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-74f3b0b5-ceb6-4cf9-9943-80deccf575eb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:19.437245 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-74f3b0b5-ceb6-4cf9-9943-80deccf575eb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:19.570843 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-74f3b0b5-ceb6-4cf9-9943-80deccf575eb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:19.579552 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-74f3b0b5-ceb6-4cf9-9943-80deccf575eb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1318 microversion: 2.1 time: 0.155606 Oct 28 12:16:19.580170 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 254/521] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:19 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:19.594707 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f4e31983-8db8-46f7-a94d-82b4702f1471 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-574753126", "imageRef": "4385a199-a3e9-4c11-b580-60e7a24d0e97", "flavorRef": "452", "networks": [{"uuid": "abc19093-1431-4203-8ce3-8a0c45f089be"}]}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:19.646491 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-f4e31983-8db8-46f7-a94d-82b4702f1471 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] validate_networks() for [('abc19093-1431-4203-8ce3-8a0c45f089be', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:16:19.720403 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9a62ae34-cac2-4f33-b92c-bfa2ca3907ae tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:19.721609 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9a62ae34-cac2-4f33-b92c-bfa2ca3907ae tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:19.727913 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9a62ae34-cac2-4f33-b92c-bfa2ca3907ae tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:19.728349 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9a62ae34-cac2-4f33-b92c-bfa2ca3907ae tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:19.729129 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9a62ae34-cac2-4f33-b92c-bfa2ca3907ae tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:19.729554 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9a62ae34-cac2-4f33-b92c-bfa2ca3907ae tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:19.989280 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-f4e31983-8db8-46f7-a94d-82b4702f1471 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:16:19.989729 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-f4e31983-8db8-46f7-a94d-82b4702f1471 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:16:19.990198 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-f4e31983-8db8-46f7-a94d-82b4702f1471 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:16:19.990747 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-f4e31983-8db8-46f7-a94d-82b4702f1471 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:16:19.991239 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-f4e31983-8db8-46f7-a94d-82b4702f1471 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:16:20.003179 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f4e31983-8db8-46f7-a94d-82b4702f1471 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:20.003968 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f4e31983-8db8-46f7-a94d-82b4702f1471 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:20.005033 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f4e31983-8db8-46f7-a94d-82b4702f1471 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:20.005819 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f4e31983-8db8-46f7-a94d-82b4702f1471 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:20.023654 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-f4e31983-8db8-46f7-a94d-82b4702f1471 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Getting quotas for project c8940dc0094a47d1a152788282bedb0e. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:16:20.027607 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-f4e31983-8db8-46f7-a94d-82b4702f1471 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Getting quotas for user 3f3b17d1ff60414d898fa16aca182c1c and project c8940dc0094a47d1a152788282bedb0e. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:16:20.038562 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f4e31983-8db8-46f7-a94d-82b4702f1471 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:16:20.040985 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f4e31983-8db8-46f7-a94d-82b4702f1471 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4385a199-a3e9-4c11-b580-60e7a24d0e97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:16:20.068288 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9a62ae34-cac2-4f33-b92c-bfa2ca3907ae tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.351948 Oct 28 12:16:20.069198 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 255/522] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:19 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:20.088044 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f4e31983-8db8-46f7-a94d-82b4702f1471 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497699 Oct 28 12:16:20.088833 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 268/523] 10.222.0.37 () {60 vars in 1146 bytes} [Thu Oct 28 12:16:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:16:20.104884 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fd04988f-946f-4f02-a834-d772b245d3a0 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:20.105930 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fd04988f-946f-4f02-a834-d772b245d3a0 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:20.169660 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fd04988f-946f-4f02-a834-d772b245d3a0 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:20.177256 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fd04988f-946f-4f02-a834-d772b245d3a0 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1218 microversion: 2.1 time: 0.082147 Oct 28 12:16:20.178099 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 256/524] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:20 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:20.245995 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-01226328-6d0e-4fcc-ae05-295e1c34c5b7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:20.247122 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-01226328-6d0e-4fcc-ae05-295e1c34c5b7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:20.255183 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01226328-6d0e-4fcc-ae05-295e1c34c5b7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:20.255639 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01226328-6d0e-4fcc-ae05-295e1c34c5b7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:20.256842 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01226328-6d0e-4fcc-ae05-295e1c34c5b7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:20.257084 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01226328-6d0e-4fcc-ae05-295e1c34c5b7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:20.478256 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-01226328-6d0e-4fcc-ae05-295e1c34c5b7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:20.488564 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-01226328-6d0e-4fcc-ae05-295e1c34c5b7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.246624 Oct 28 12:16:20.489150 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 269/525] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:20 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:20.598940 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8f38681a-ce9e-472e-9cbf-72ce5a459e7e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:20.599772 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8f38681a-ce9e-472e-9cbf-72ce5a459e7e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:20.607860 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8f38681a-ce9e-472e-9cbf-72ce5a459e7e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:20.608544 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8f38681a-ce9e-472e-9cbf-72ce5a459e7e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:20.609388 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8f38681a-ce9e-472e-9cbf-72ce5a459e7e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:20.609831 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8f38681a-ce9e-472e-9cbf-72ce5a459e7e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:20.918642 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8f38681a-ce9e-472e-9cbf-72ce5a459e7e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:20.926691 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8f38681a-ce9e-472e-9cbf-72ce5a459e7e tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1318 microversion: 2.1 time: 0.333249 Oct 28 12:16:20.927268 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 257/526] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:20 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:21.080493 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a6567006-7af5-46a8-ba21-51c0e7befaf0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:21.081453 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a6567006-7af5-46a8-ba21-51c0e7befaf0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:21.087878 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6567006-7af5-46a8-ba21-51c0e7befaf0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:21.088328 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6567006-7af5-46a8-ba21-51c0e7befaf0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:21.089090 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6567006-7af5-46a8-ba21-51c0e7befaf0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:21.089550 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6567006-7af5-46a8-ba21-51c0e7befaf0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:21.195327 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-05bcf480-d03a-4049-a996-94e9a981fb4c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:21.195926 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-05bcf480-d03a-4049-a996-94e9a981fb4c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:21.201949 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-05bcf480-d03a-4049-a996-94e9a981fb4c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:21.202394 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-05bcf480-d03a-4049-a996-94e9a981fb4c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:21.203239 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-05bcf480-d03a-4049-a996-94e9a981fb4c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:21.203672 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-05bcf480-d03a-4049-a996-94e9a981fb4c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:21.267019 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-05bcf480-d03a-4049-a996-94e9a981fb4c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:21.274766 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-05bcf480-d03a-4049-a996-94e9a981fb4c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1270 microversion: 2.1 time: 0.083414 Oct 28 12:16:21.275332 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 258/527] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:21 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:21.358879 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a6567006-7af5-46a8-ba21-51c0e7befaf0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.282300 Oct 28 12:16:21.359747 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 270/528] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:21 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:21.507209 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-99a78134-0e72-4929-a362-19f14bd61049 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:21.508465 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-99a78134-0e72-4929-a362-19f14bd61049 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:21.516873 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-99a78134-0e72-4929-a362-19f14bd61049 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:21.517323 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-99a78134-0e72-4929-a362-19f14bd61049 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:21.518279 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-99a78134-0e72-4929-a362-19f14bd61049 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:21.518736 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-99a78134-0e72-4929-a362-19f14bd61049 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:21.692265 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-99a78134-0e72-4929-a362-19f14bd61049 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:21.702212 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-99a78134-0e72-4929-a362-19f14bd61049 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.199542 Oct 28 12:16:21.702822 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 259/529] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:21 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:21.944919 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cb6553ff-12c5-4b93-90e3-0dc0dd42f2ad tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:21.946023 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cb6553ff-12c5-4b93-90e3-0dc0dd42f2ad tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:21.958640 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb6553ff-12c5-4b93-90e3-0dc0dd42f2ad tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:21.959116 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb6553ff-12c5-4b93-90e3-0dc0dd42f2ad tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:21.959901 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb6553ff-12c5-4b93-90e3-0dc0dd42f2ad tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:21.960331 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb6553ff-12c5-4b93-90e3-0dc0dd42f2ad tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:22.292118 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a38ac1a2-4146-4a52-b947-02e200bff992 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:22.292851 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a38ac1a2-4146-4a52-b947-02e200bff992 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:22.299793 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a38ac1a2-4146-4a52-b947-02e200bff992 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:22.300231 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a38ac1a2-4146-4a52-b947-02e200bff992 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:22.300994 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a38ac1a2-4146-4a52-b947-02e200bff992 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:22.301417 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a38ac1a2-4146-4a52-b947-02e200bff992 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:22.321125 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cb6553ff-12c5-4b93-90e3-0dc0dd42f2ad tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:22.329562 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cb6553ff-12c5-4b93-90e3-0dc0dd42f2ad tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1318 microversion: 2.1 time: 0.389004 Oct 28 12:16:22.339654 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 271/530] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:21 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:22.370660 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bb5af4a5-87bc-415a-b05a-09fdc787c465 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:22.371589 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bb5af4a5-87bc-415a-b05a-09fdc787c465 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:22.377505 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb5af4a5-87bc-415a-b05a-09fdc787c465 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:22.377939 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb5af4a5-87bc-415a-b05a-09fdc787c465 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:22.378719 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb5af4a5-87bc-415a-b05a-09fdc787c465 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:22.379156 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bb5af4a5-87bc-415a-b05a-09fdc787c465 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:22.439005 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a38ac1a2-4146-4a52-b947-02e200bff992 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:22.446202 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a38ac1a2-4146-4a52-b947-02e200bff992 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1318 microversion: 2.1 time: 0.157792 Oct 28 12:16:22.446782 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 260/531] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:22 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:22.571803 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bb5af4a5-87bc-415a-b05a-09fdc787c465 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.204562 Oct 28 12:16:22.572816 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 272/532] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:22 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:22.719399 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-77e9d2af-6b41-422a-b28f-44559ec0f27c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:22.720612 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-77e9d2af-6b41-422a-b28f-44559ec0f27c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:22.728487 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77e9d2af-6b41-422a-b28f-44559ec0f27c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:22.729186 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77e9d2af-6b41-422a-b28f-44559ec0f27c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:22.730183 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77e9d2af-6b41-422a-b28f-44559ec0f27c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:22.730582 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77e9d2af-6b41-422a-b28f-44559ec0f27c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:22.865354 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-77e9d2af-6b41-422a-b28f-44559ec0f27c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:22.877749 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-77e9d2af-6b41-422a-b28f-44559ec0f27c tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.162451 Oct 28 12:16:22.878320 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 261/533] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:22 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:23.109209 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-49f6aa53-48ff-4fe1-897e-3f43795cc1ab req-30609865-5839-42e5-80da-67fa1b33b1db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15ebab3a-a58c-4216-862c-564d4d365c37", "tag": "1619934b-8d83-409a-9b55-2549b46519eb"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:23.111331 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:16:23.111331 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:16:23.120667 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-49f6aa53-48ff-4fe1-897e-3f43795cc1ab req-30609865-5839-42e5-80da-67fa1b33b1db service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:23.121066 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-49f6aa53-48ff-4fe1-897e-3f43795cc1ab req-30609865-5839-42e5-80da-67fa1b33b1db service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:23.133234 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-49f6aa53-48ff-4fe1-897e-3f43795cc1ab req-30609865-5839-42e5-80da-67fa1b33b1db service nova] Creating event network-changed:1619934b-8d83-409a-9b55-2549b46519eb for instance 15ebab3a-a58c-4216-862c-564d4d365c37 on hv-cinder-81571 Oct 28 12:16:23.137826 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-49f6aa53-48ff-4fe1-897e-3f43795cc1ab req-30609865-5839-42e5-80da-67fa1b33b1db service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032969 Oct 28 12:16:23.138468 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 273/534] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:16:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:16:23.346389 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a880e409-b39f-4106-a68d-ca995710c959 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:23.347055 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a880e409-b39f-4106-a68d-ca995710c959 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:23.353134 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a880e409-b39f-4106-a68d-ca995710c959 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:23.353583 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a880e409-b39f-4106-a68d-ca995710c959 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:23.354349 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a880e409-b39f-4106-a68d-ca995710c959 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:23.354873 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a880e409-b39f-4106-a68d-ca995710c959 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:23.462550 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b7e8b6ba-a83d-4a9c-b44e-50c319fb19d3 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:23.463427 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b7e8b6ba-a83d-4a9c-b44e-50c319fb19d3 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:23.470948 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b7e8b6ba-a83d-4a9c-b44e-50c319fb19d3 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:23.471405 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b7e8b6ba-a83d-4a9c-b44e-50c319fb19d3 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:23.472250 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b7e8b6ba-a83d-4a9c-b44e-50c319fb19d3 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:23.472864 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b7e8b6ba-a83d-4a9c-b44e-50c319fb19d3 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:23.487828 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a880e409-b39f-4106-a68d-ca995710c959 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:23.496115 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a880e409-b39f-4106-a68d-ca995710c959 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1318 microversion: 2.1 time: 0.153939 Oct 28 12:16:23.497358 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 262/535] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:23 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:23.585065 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b4ce457f-e814-474a-999a-3f1ff1c3f5b8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:23.586022 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b4ce457f-e814-474a-999a-3f1ff1c3f5b8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:23.592634 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4ce457f-e814-474a-999a-3f1ff1c3f5b8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:23.593100 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4ce457f-e814-474a-999a-3f1ff1c3f5b8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:23.593954 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4ce457f-e814-474a-999a-3f1ff1c3f5b8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:23.594475 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4ce457f-e814-474a-999a-3f1ff1c3f5b8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:23.671399 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b4ce457f-e814-474a-999a-3f1ff1c3f5b8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.089286 Oct 28 12:16:23.672869 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 263/536] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:23 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:16:23.685306 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b7e8b6ba-a83d-4a9c-b44e-50c319fb19d3 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:23.692462 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b7e8b6ba-a83d-4a9c-b44e-50c319fb19d3 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1318 microversion: 2.1 time: 0.233860 Oct 28 12:16:23.693024 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 274/537] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:23 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:23.895585 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-47549239-f05b-48e0-a8cd-673063e63209 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:23.896405 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-47549239-f05b-48e0-a8cd-673063e63209 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:23.905085 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47549239-f05b-48e0-a8cd-673063e63209 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:23.905777 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47549239-f05b-48e0-a8cd-673063e63209 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:23.906890 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47549239-f05b-48e0-a8cd-673063e63209 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:23.907559 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47549239-f05b-48e0-a8cd-673063e63209 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:24.089968 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-47549239-f05b-48e0-a8cd-673063e63209 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:24.099166 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-47549239-f05b-48e0-a8cd-673063e63209 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1567 microversion: 2.1 time: 0.207542 Oct 28 12:16:24.099782 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 264/538] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:23 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:24.515358 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b6d1cfe9-e944-4e3b-8109-8f181fce7198 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:24.516248 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b6d1cfe9-e944-4e3b-8109-8f181fce7198 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:24.523421 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b6d1cfe9-e944-4e3b-8109-8f181fce7198 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:24.523900 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b6d1cfe9-e944-4e3b-8109-8f181fce7198 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:24.524917 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b6d1cfe9-e944-4e3b-8109-8f181fce7198 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:24.525344 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b6d1cfe9-e944-4e3b-8109-8f181fce7198 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:24.656126 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b6d1cfe9-e944-4e3b-8109-8f181fce7198 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:24.664060 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b6d1cfe9-e944-4e3b-8109-8f181fce7198 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1318 microversion: 2.1 time: 0.153084 Oct 28 12:16:24.664662 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 275/539] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:24 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:24.683018 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-44f6245a-667e-4ffc-bdfc-00148e8b3273 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:24.684315 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-44f6245a-667e-4ffc-bdfc-00148e8b3273 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:24.691142 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44f6245a-667e-4ffc-bdfc-00148e8b3273 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:24.691702 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44f6245a-667e-4ffc-bdfc-00148e8b3273 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:24.692548 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44f6245a-667e-4ffc-bdfc-00148e8b3273 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:24.693066 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44f6245a-667e-4ffc-bdfc-00148e8b3273 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:24.710121 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-51de6832-5134-480a-a2a1-b6e0e10179fb tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:24.711672 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-51de6832-5134-480a-a2a1-b6e0e10179fb tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:24.718090 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-51de6832-5134-480a-a2a1-b6e0e10179fb tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:24.718624 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-51de6832-5134-480a-a2a1-b6e0e10179fb tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:24.721588 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-51de6832-5134-480a-a2a1-b6e0e10179fb tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:24.722047 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-51de6832-5134-480a-a2a1-b6e0e10179fb tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:24.832538 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-44f6245a-667e-4ffc-bdfc-00148e8b3273 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.153205 Oct 28 12:16:24.835930 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 265/540] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:24 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:24.846641 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-51de6832-5134-480a-a2a1-b6e0e10179fb tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:24.853772 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-51de6832-5134-480a-a2a1-b6e0e10179fb tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1318 microversion: 2.1 time: 0.148255 Oct 28 12:16:24.854336 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 276/541] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:24 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:25.118256 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-935fb1e8-59ea-41a7-99d5-81c6388fb10f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:25.118975 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-935fb1e8-59ea-41a7-99d5-81c6388fb10f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:25.125928 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-935fb1e8-59ea-41a7-99d5-81c6388fb10f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:25.126313 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-935fb1e8-59ea-41a7-99d5-81c6388fb10f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:25.127144 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-935fb1e8-59ea-41a7-99d5-81c6388fb10f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:25.127641 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-935fb1e8-59ea-41a7-99d5-81c6388fb10f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:25.247440 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-935fb1e8-59ea-41a7-99d5-81c6388fb10f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:25.255593 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-935fb1e8-59ea-41a7-99d5-81c6388fb10f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1547 microversion: 2.1 time: 0.142499 Oct 28 12:16:25.256246 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 266/542] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:25 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1547 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:25.272048 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c9ca2a87-6cbe-43ee-b0d9-f18eb494561d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:25.272535 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c9ca2a87-6cbe-43ee-b0d9-f18eb494561d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:25.278390 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c9ca2a87-6cbe-43ee-b0d9-f18eb494561d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:25.278999 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c9ca2a87-6cbe-43ee-b0d9-f18eb494561d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:25.279833 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c9ca2a87-6cbe-43ee-b0d9-f18eb494561d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:25.280333 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c9ca2a87-6cbe-43ee-b0d9-f18eb494561d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:25.361071 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-c9ca2a87-6cbe-43ee-b0d9-f18eb494561d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] HTTP exception thrown: Cannot 'detach_volume' instance 28b1cf11-e525-409b-83da-1c26e1d9937d while it is in vm_state rescued Oct 28 12:16:25.361669 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c9ca2a87-6cbe-43ee-b0d9-f18eb494561d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Returning 409 to user: Cannot 'detach_volume' instance 28b1cf11-e525-409b-83da-1c26e1d9937d while it is in vm_state rescued {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:16:25.362529 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c9ca2a87-6cbe-43ee-b0d9-f18eb494561d tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "DELETE /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments/0248aef7-1fd1-4086-b111-4c3653f15fa9" status: 409 len: 152 microversion: 2.1 time: 0.094198 Oct 28 12:16:25.363114 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 277/543] 10.222.0.37 () {58 vars in 1415 bytes} [Thu Oct 28 12:16:25 2021] DELETE /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments/0248aef7-1fd1-4086-b111-4c3653f15fa9 => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 12:16:25.371669 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-49309a15-8f0c-41eb-9081-382611d56bc4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:25.372250 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-49309a15-8f0c-41eb-9081-382611d56bc4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:25.379321 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-49309a15-8f0c-41eb-9081-382611d56bc4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:25.379775 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-49309a15-8f0c-41eb-9081-382611d56bc4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:25.380602 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-49309a15-8f0c-41eb-9081-382611d56bc4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:25.381266 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-49309a15-8f0c-41eb-9081-382611d56bc4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:25.451461 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-49309a15-8f0c-41eb-9081-382611d56bc4 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "POST /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/action" status: 202 len: 0 microversion: 2.1 time: 0.082768 Oct 28 12:16:25.455541 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 267/544] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:16:25 2021] POST /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:16:25.460639 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ad584cd5-28ec-498a-96f4-1b7a1fb2c3ac tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:25.461247 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ad584cd5-28ec-498a-96f4-1b7a1fb2c3ac tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:25.467717 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ad584cd5-28ec-498a-96f4-1b7a1fb2c3ac tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:25.468311 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ad584cd5-28ec-498a-96f4-1b7a1fb2c3ac tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:25.469131 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ad584cd5-28ec-498a-96f4-1b7a1fb2c3ac tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:25.469645 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ad584cd5-28ec-498a-96f4-1b7a1fb2c3ac tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:25.544103 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a1cfa9c6-a22d-4997-8e1a-7b9841cc3626 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-863948852", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-669426014", "security_groups": [{"name": "tempest-secgroup-smoke-1965128848"}], "networks": [{"uuid": "53c8dfe6-6127-403c-8d96-5039ee2f5ff8"}], "block_device_mapping_v2": [{"uuid": "a27f6278-bb44-44da-8c67-7b2249e02b2d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:25.649746 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-a1cfa9c6-a22d-4997-8e1a-7b9841cc3626 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] validate_networks() for [('53c8dfe6-6127-403c-8d96-5039ee2f5ff8', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:16:25.667240 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ad584cd5-28ec-498a-96f4-1b7a1fb2c3ac tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:25.690743 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ad584cd5-28ec-498a-96f4-1b7a1fb2c3ac tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1555 microversion: 2.1 time: 0.232734 Oct 28 12:16:25.690743 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 278/545] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:25 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1555 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:25.706992 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-891291d0-b2bf-42a1-84c2-8cda0f2fd7e8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:25.710146 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-891291d0-b2bf-42a1-84c2-8cda0f2fd7e8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:25.717005 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-891291d0-b2bf-42a1-84c2-8cda0f2fd7e8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:25.717835 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-891291d0-b2bf-42a1-84c2-8cda0f2fd7e8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:25.720009 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-891291d0-b2bf-42a1-84c2-8cda0f2fd7e8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:25.720604 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-891291d0-b2bf-42a1-84c2-8cda0f2fd7e8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:25.947406 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-891291d0-b2bf-42a1-84c2-8cda0f2fd7e8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:25.956111 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-891291d0-b2bf-42a1-84c2-8cda0f2fd7e8 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1318 microversion: 2.1 time: 0.253360 Oct 28 12:16:25.956693 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 279/546] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:25 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:25.961264 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-defa1a62-34d8-4f60-af16-9ddf2bf20345 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:25.962241 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-defa1a62-34d8-4f60-af16-9ddf2bf20345 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:25.968623 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-defa1a62-34d8-4f60-af16-9ddf2bf20345 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:25.969066 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-defa1a62-34d8-4f60-af16-9ddf2bf20345 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:25.969835 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-defa1a62-34d8-4f60-af16-9ddf2bf20345 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:25.970270 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-defa1a62-34d8-4f60-af16-9ddf2bf20345 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:26.045360 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-defa1a62-34d8-4f60-af16-9ddf2bf20345 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.087239 Oct 28 12:16:26.049530 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 280/547] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:25 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:26.056699 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-913c196e-3d2c-4598-82c1-70f234523b83 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:26.057395 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-913c196e-3d2c-4598-82c1-70f234523b83 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:26.065694 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-913c196e-3d2c-4598-82c1-70f234523b83 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:26.066142 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-913c196e-3d2c-4598-82c1-70f234523b83 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:26.067202 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-913c196e-3d2c-4598-82c1-70f234523b83 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:26.070515 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-a1cfa9c6-a22d-4997-8e1a-7b9841cc3626 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:16:26.071242 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-913c196e-3d2c-4598-82c1-70f234523b83 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:26.071363 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-a1cfa9c6-a22d-4997-8e1a-7b9841cc3626 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:16:26.071483 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-a1cfa9c6-a22d-4997-8e1a-7b9841cc3626 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:16:26.072069 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-a1cfa9c6-a22d-4997-8e1a-7b9841cc3626 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:16:26.072478 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-a1cfa9c6-a22d-4997-8e1a-7b9841cc3626 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:16:26.083393 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a1cfa9c6-a22d-4997-8e1a-7b9841cc3626 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:26.084114 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a1cfa9c6-a22d-4997-8e1a-7b9841cc3626 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:26.085140 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a1cfa9c6-a22d-4997-8e1a-7b9841cc3626 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:26.085569 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a1cfa9c6-a22d-4997-8e1a-7b9841cc3626 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:26.104806 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-a1cfa9c6-a22d-4997-8e1a-7b9841cc3626 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Getting quotas for project a714ee6cfd984bbf823ab5c422c5a3eb. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:16:26.109105 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-a1cfa9c6-a22d-4997-8e1a-7b9841cc3626 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Getting quotas for user 6695129614aa49dc9fcc1e1b27083b98 and project a714ee6cfd984bbf823ab5c422c5a3eb. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:16:26.173693 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a1cfa9c6-a22d-4997-8e1a-7b9841cc3626 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:16:26.176938 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a1cfa9c6-a22d-4997-8e1a-7b9841cc3626 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a27f6278-bb44-44da-8c67-7b2249e02b2d',volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:16:26.219202 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-913c196e-3d2c-4598-82c1-70f234523b83 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:26.227465 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-913c196e-3d2c-4598-82c1-70f234523b83 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1318 microversion: 2.1 time: 0.175679 Oct 28 12:16:26.228038 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 281/548] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:26 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:26.307439 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a1cfa9c6-a22d-4997-8e1a-7b9841cc3626 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.767751 Oct 28 12:16:26.308110 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 268/549] 10.222.0.37 () {60 vars in 1146 bytes} [Thu Oct 28 12:16:25 2021] POST /compute/v2.1/servers => generated 406 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 12:16:26.318389 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-91ffb9a5-9b5c-46a1-beb2-dcff0c9420d4 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:26.319012 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-91ffb9a5-9b5c-46a1-beb2-dcff0c9420d4 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:26.369770 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-91ffb9a5-9b5c-46a1-beb2-dcff0c9420d4 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:26.377669 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-91ffb9a5-9b5c-46a1-beb2-dcff0c9420d4 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1087 microversion: 2.1 time: 0.062814 Oct 28 12:16:26.378235 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 282/550] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:26 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1087 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:26.709186 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fce19bcb-74da-4f2a-a7c6-aada4e1f9ac6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:26.709736 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fce19bcb-74da-4f2a-a7c6-aada4e1f9ac6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:26.717078 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fce19bcb-74da-4f2a-a7c6-aada4e1f9ac6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:26.717933 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fce19bcb-74da-4f2a-a7c6-aada4e1f9ac6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:26.718934 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fce19bcb-74da-4f2a-a7c6-aada4e1f9ac6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:26.719562 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fce19bcb-74da-4f2a-a7c6-aada4e1f9ac6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:26.858123 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fce19bcb-74da-4f2a-a7c6-aada4e1f9ac6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:26.866039 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fce19bcb-74da-4f2a-a7c6-aada4e1f9ac6 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1555 microversion: 2.1 time: 0.161092 Oct 28 12:16:26.866921 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 269/551] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:26 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:26.973215 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-640c5343-6acb-401f-ae62-ea506f56de0f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:26.973758 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-640c5343-6acb-401f-ae62-ea506f56de0f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:26.980024 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-640c5343-6acb-401f-ae62-ea506f56de0f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:26.980465 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-640c5343-6acb-401f-ae62-ea506f56de0f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:26.981232 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-640c5343-6acb-401f-ae62-ea506f56de0f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:26.981662 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-640c5343-6acb-401f-ae62-ea506f56de0f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:27.065728 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3f1491b9-2c29-406b-8573-3e062a105293 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:27.067077 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3f1491b9-2c29-406b-8573-3e062a105293 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:27.072898 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3f1491b9-2c29-406b-8573-3e062a105293 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:27.073341 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3f1491b9-2c29-406b-8573-3e062a105293 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:27.074108 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3f1491b9-2c29-406b-8573-3e062a105293 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:27.074574 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3f1491b9-2c29-406b-8573-3e062a105293 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:27.109660 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-640c5343-6acb-401f-ae62-ea506f56de0f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:27.116991 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-640c5343-6acb-401f-ae62-ea506f56de0f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1318 microversion: 2.1 time: 0.147537 Oct 28 12:16:27.117562 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 283/552] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:26 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:27.201107 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3f1491b9-2c29-406b-8573-3e062a105293 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.140330 Oct 28 12:16:27.201764 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 270/553] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:27 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:16:27.245509 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-36d138ef-949e-4936-92c6-1d7d54fc29e7 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:27.246040 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-36d138ef-949e-4936-92c6-1d7d54fc29e7 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:27.251915 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-36d138ef-949e-4936-92c6-1d7d54fc29e7 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:27.252374 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-36d138ef-949e-4936-92c6-1d7d54fc29e7 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:27.253133 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-36d138ef-949e-4936-92c6-1d7d54fc29e7 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:27.253564 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-36d138ef-949e-4936-92c6-1d7d54fc29e7 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:27.378232 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-36d138ef-949e-4936-92c6-1d7d54fc29e7 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:27.385451 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-36d138ef-949e-4936-92c6-1d7d54fc29e7 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1318 microversion: 2.1 time: 0.143727 Oct 28 12:16:27.386011 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 284/554] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:27 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:27.395854 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f3b58ccb-14f3-4ba7-b43e-620737daf750 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:27.396871 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f3b58ccb-14f3-4ba7-b43e-620737daf750 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:27.403576 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3b58ccb-14f3-4ba7-b43e-620737daf750 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:27.404704 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3b58ccb-14f3-4ba7-b43e-620737daf750 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:27.405547 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3b58ccb-14f3-4ba7-b43e-620737daf750 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:27.405976 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3b58ccb-14f3-4ba7-b43e-620737daf750 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:27.472718 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f3b58ccb-14f3-4ba7-b43e-620737daf750 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:27.480552 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f3b58ccb-14f3-4ba7-b43e-620737daf750 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1193 microversion: 2.1 time: 0.088718 Oct 28 12:16:27.481110 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 271/555] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:27 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:27.884128 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3107a3c2-22f6-4adf-9d87-057f91d2b389 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:27.884738 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3107a3c2-22f6-4adf-9d87-057f91d2b389 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:27.892564 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3107a3c2-22f6-4adf-9d87-057f91d2b389 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:27.893299 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3107a3c2-22f6-4adf-9d87-057f91d2b389 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:27.894338 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3107a3c2-22f6-4adf-9d87-057f91d2b389 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:27.894963 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3107a3c2-22f6-4adf-9d87-057f91d2b389 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:28.086440 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3107a3c2-22f6-4adf-9d87-057f91d2b389 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:28.096219 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3107a3c2-22f6-4adf-9d87-057f91d2b389 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1555 microversion: 2.1 time: 0.215715 Oct 28 12:16:28.098115 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 285/556] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:27 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1555 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:28.134536 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-32c593d8-6757-4b12-8249-bcf09a9e5e37 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:28.135472 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-32c593d8-6757-4b12-8249-bcf09a9e5e37 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:28.141826 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32c593d8-6757-4b12-8249-bcf09a9e5e37 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:28.142346 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32c593d8-6757-4b12-8249-bcf09a9e5e37 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:28.143231 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32c593d8-6757-4b12-8249-bcf09a9e5e37 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:28.143729 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-32c593d8-6757-4b12-8249-bcf09a9e5e37 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:28.215330 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-969a95c1-62fc-4d37-b9c8-7ba1e7f795f7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:28.217930 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-969a95c1-62fc-4d37-b9c8-7ba1e7f795f7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:28.229689 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-969a95c1-62fc-4d37-b9c8-7ba1e7f795f7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:28.230463 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-969a95c1-62fc-4d37-b9c8-7ba1e7f795f7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:28.232736 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-969a95c1-62fc-4d37-b9c8-7ba1e7f795f7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:28.233367 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-969a95c1-62fc-4d37-b9c8-7ba1e7f795f7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:28.311667 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-969a95c1-62fc-4d37-b9c8-7ba1e7f795f7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.102237 Oct 28 12:16:28.312794 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 286/557] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:28 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:28.320362 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-32c593d8-6757-4b12-8249-bcf09a9e5e37 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:28.330577 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-32c593d8-6757-4b12-8249-bcf09a9e5e37 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1318 microversion: 2.1 time: 0.199658 Oct 28 12:16:28.331587 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 272/558] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:28 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:28.405448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b05377af-1c44-418d-861c-83d3f67867e8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:28.406377 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b05377af-1c44-418d-861c-83d3f67867e8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:28.414448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b05377af-1c44-418d-861c-83d3f67867e8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:28.415390 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b05377af-1c44-418d-861c-83d3f67867e8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:28.416894 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b05377af-1c44-418d-861c-83d3f67867e8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:28.417744 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b05377af-1c44-418d-861c-83d3f67867e8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:28.498674 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c2dfa91e-330c-4532-a17b-609392a4c170 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:28.499644 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c2dfa91e-330c-4532-a17b-609392a4c170 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:28.509174 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c2dfa91e-330c-4532-a17b-609392a4c170 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:28.510016 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c2dfa91e-330c-4532-a17b-609392a4c170 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:28.511353 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c2dfa91e-330c-4532-a17b-609392a4c170 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:28.512002 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c2dfa91e-330c-4532-a17b-609392a4c170 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:28.644542 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b05377af-1c44-418d-861c-83d3f67867e8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:28.651900 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b05377af-1c44-418d-861c-83d3f67867e8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1318 microversion: 2.1 time: 0.252159 Oct 28 12:16:28.661400 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 287/559] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:28 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:28.666329 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-28023499-7e1e-43b0-ae33-dbb8e0f5c05c req-d1452536-4f0d-4368-87f6-4a77c49e35bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da336b35-558a-46d7-a7ca-9799568bbec3", "name": "network-vif-plugged", "status": "completed", "tag": "cb078e40-acbe-40fd-aa54-76513a780403"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:28.668029 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:16:28.668029 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:16:28.676507 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-28023499-7e1e-43b0-ae33-dbb8e0f5c05c req-d1452536-4f0d-4368-87f6-4a77c49e35bc service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:28.676507 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-28023499-7e1e-43b0-ae33-dbb8e0f5c05c req-d1452536-4f0d-4368-87f6-4a77c49e35bc service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:28.685553 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c2dfa91e-330c-4532-a17b-609392a4c170 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:28.688429 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-28023499-7e1e-43b0-ae33-dbb8e0f5c05c req-d1452536-4f0d-4368-87f6-4a77c49e35bc service nova] Creating event network-vif-plugged:cb078e40-acbe-40fd-aa54-76513a780403 for instance da336b35-558a-46d7-a7ca-9799568bbec3 on hv-cinder-81571 Oct 28 12:16:28.693247 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-28023499-7e1e-43b0-ae33-dbb8e0f5c05c req-d1452536-4f0d-4368-87f6-4a77c49e35bc service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030584 Oct 28 12:16:28.693832 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 288/560] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:16:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:16:28.697077 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c2dfa91e-330c-4532-a17b-609392a4c170 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1259 microversion: 2.1 time: 0.203238 Oct 28 12:16:28.697635 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 273/561] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:28 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1259 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:29.027921 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-3f4fbe9f-56fc-40fa-b8ad-e1be08c6b928 req-91e07ce6-00f4-4297-82f0-99c6fa2e0ecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aa26e71-aa24-4d33-9b9f-96d11867d037", "tag": "6d493e72-8230-488e-974e-b32ede2a9db0"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:29.030125 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:16:29.030125 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:16:29.043099 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-3f4fbe9f-56fc-40fa-b8ad-e1be08c6b928 req-91e07ce6-00f4-4297-82f0-99c6fa2e0ecf service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:29.044687 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-3f4fbe9f-56fc-40fa-b8ad-e1be08c6b928 req-91e07ce6-00f4-4297-82f0-99c6fa2e0ecf service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:29.059414 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-3f4fbe9f-56fc-40fa-b8ad-e1be08c6b928 req-91e07ce6-00f4-4297-82f0-99c6fa2e0ecf service nova] Creating event network-changed:6d493e72-8230-488e-974e-b32ede2a9db0 for instance 8aa26e71-aa24-4d33-9b9f-96d11867d037 on hv-cinder-81571 Oct 28 12:16:29.065750 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-3f4fbe9f-56fc-40fa-b8ad-e1be08c6b928 req-91e07ce6-00f4-4297-82f0-99c6fa2e0ecf service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042933 Oct 28 12:16:29.066999 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 289/562] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:16:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:16:29.113237 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7892e506-2799-4574-b8ad-2931e9c2aca3 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:29.114254 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7892e506-2799-4574-b8ad-2931e9c2aca3 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:29.123246 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7892e506-2799-4574-b8ad-2931e9c2aca3 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:29.124989 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7892e506-2799-4574-b8ad-2931e9c2aca3 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:29.126359 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7892e506-2799-4574-b8ad-2931e9c2aca3 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:29.127229 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7892e506-2799-4574-b8ad-2931e9c2aca3 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:29.272511 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7892e506-2799-4574-b8ad-2931e9c2aca3 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:29.280807 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7892e506-2799-4574-b8ad-2931e9c2aca3 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1555 microversion: 2.1 time: 0.171243 Oct 28 12:16:29.281375 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 274/563] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:29 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:29.325741 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c5c4c2b1-4ed3-45df-93ea-ec13e53c7556 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:29.327196 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c5c4c2b1-4ed3-45df-93ea-ec13e53c7556 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:29.333509 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c5c4c2b1-4ed3-45df-93ea-ec13e53c7556 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:29.333997 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c5c4c2b1-4ed3-45df-93ea-ec13e53c7556 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:29.335087 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c5c4c2b1-4ed3-45df-93ea-ec13e53c7556 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:29.335802 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c5c4c2b1-4ed3-45df-93ea-ec13e53c7556 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:29.348078 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1c7c6b77-bcf6-48b1-bb91-2eadd539634d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:29.348684 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1c7c6b77-bcf6-48b1-bb91-2eadd539634d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:29.356280 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c7c6b77-bcf6-48b1-bb91-2eadd539634d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:29.356724 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c7c6b77-bcf6-48b1-bb91-2eadd539634d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:29.358028 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c7c6b77-bcf6-48b1-bb91-2eadd539634d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:29.358461 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c7c6b77-bcf6-48b1-bb91-2eadd539634d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:29.493013 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1c7c6b77-bcf6-48b1-bb91-2eadd539634d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:29.501318 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1c7c6b77-bcf6-48b1-bb91-2eadd539634d tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1318 microversion: 2.1 time: 0.157218 Oct 28 12:16:29.510318 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 275/564] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:29 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:29.563438 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c5c4c2b1-4ed3-45df-93ea-ec13e53c7556 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.242410 Oct 28 12:16:29.564010 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 290/565] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:29 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:29.668465 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4c4cb984-4035-40b4-ab46-c29c984ddacf tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:29.669062 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4c4cb984-4035-40b4-ab46-c29c984ddacf tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:29.675648 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4c4cb984-4035-40b4-ab46-c29c984ddacf tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:29.676080 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4c4cb984-4035-40b4-ab46-c29c984ddacf tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:29.676828 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4c4cb984-4035-40b4-ab46-c29c984ddacf tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:29.677245 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4c4cb984-4035-40b4-ab46-c29c984ddacf tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:29.715441 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-194156e8-b951-4a2d-a0c1-ea37fe42b0a7 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:29.716633 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-194156e8-b951-4a2d-a0c1-ea37fe42b0a7 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:29.723663 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-194156e8-b951-4a2d-a0c1-ea37fe42b0a7 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:29.724109 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-194156e8-b951-4a2d-a0c1-ea37fe42b0a7 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:29.724885 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-194156e8-b951-4a2d-a0c1-ea37fe42b0a7 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:29.725316 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-194156e8-b951-4a2d-a0c1-ea37fe42b0a7 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:29.812296 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4c4cb984-4035-40b4-ab46-c29c984ddacf tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:29.819589 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4c4cb984-4035-40b4-ab46-c29c984ddacf tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1318 microversion: 2.1 time: 0.154646 Oct 28 12:16:29.820126 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 276/566] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:29 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:29.889229 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-194156e8-b951-4a2d-a0c1-ea37fe42b0a7 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:29.896684 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-194156e8-b951-4a2d-a0c1-ea37fe42b0a7 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1259 microversion: 2.1 time: 0.185174 Oct 28 12:16:29.897258 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 291/567] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:29 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:30.297237 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3d966b02-c6bf-4641-85d9-fcd60eeb110f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:30.297917 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3d966b02-c6bf-4641-85d9-fcd60eeb110f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:30.304053 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d966b02-c6bf-4641-85d9-fcd60eeb110f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:30.304497 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d966b02-c6bf-4641-85d9-fcd60eeb110f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:30.305261 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d966b02-c6bf-4641-85d9-fcd60eeb110f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:30.305690 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d966b02-c6bf-4641-85d9-fcd60eeb110f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:30.423994 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3d966b02-c6bf-4641-85d9-fcd60eeb110f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:30.431654 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3d966b02-c6bf-4641-85d9-fcd60eeb110f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1561 microversion: 2.1 time: 0.138315 Oct 28 12:16:30.432207 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 277/568] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:30 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1561 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:30.502336 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fa8ebb58-1997-4f3a-a54d-e35aca42ea55 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:30.502878 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fa8ebb58-1997-4f3a-a54d-e35aca42ea55 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:30.509191 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fa8ebb58-1997-4f3a-a54d-e35aca42ea55 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:30.509635 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fa8ebb58-1997-4f3a-a54d-e35aca42ea55 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:30.510397 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fa8ebb58-1997-4f3a-a54d-e35aca42ea55 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:30.510857 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fa8ebb58-1997-4f3a-a54d-e35aca42ea55 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:30.517611 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-663935ff-4c1f-40cc-a49c-ada3b5238794 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:30.518444 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-663935ff-4c1f-40cc-a49c-ada3b5238794 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:30.524674 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-663935ff-4c1f-40cc-a49c-ada3b5238794 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:30.525117 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-663935ff-4c1f-40cc-a49c-ada3b5238794 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:30.526165 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-663935ff-4c1f-40cc-a49c-ada3b5238794 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:30.526843 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-663935ff-4c1f-40cc-a49c-ada3b5238794 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:30.590999 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-fa8ebb58-1997-4f3a-a54d-e35aca42ea55 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lazy-loading 'services' on Instance uuid 28b1cf11-e525-409b-83da-1c26e1d9937d {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:16:30.650479 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-663935ff-4c1f-40cc-a49c-ada3b5238794 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:30.658560 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-663935ff-4c1f-40cc-a49c-ada3b5238794 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1318 microversion: 2.1 time: 0.145283 Oct 28 12:16:30.659212 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 278/569] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:30 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:30.659814 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fa8ebb58-1997-4f3a-a54d-e35aca42ea55 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "DELETE /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments/0248aef7-1fd1-4086-b111-4c3653f15fa9" status: 202 len: 0 microversion: 2.1 time: 0.162173 Oct 28 12:16:30.663498 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 292/570] 10.222.0.37 () {58 vars in 1415 bytes} [Thu Oct 28 12:16:30 2021] DELETE /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments/0248aef7-1fd1-4086-b111-4c3653f15fa9 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:30.663644 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-30610d28-d405-4794-b95b-c276dfb2d019 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:30.664573 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-30610d28-d405-4794-b95b-c276dfb2d019 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:30.669438 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-33e735b6-94f2-429d-bd29-2c8eccc95b15 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:30.670544 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-33e735b6-94f2-429d-bd29-2c8eccc95b15 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:30.671217 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-30610d28-d405-4794-b95b-c276dfb2d019 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:30.671655 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-30610d28-d405-4794-b95b-c276dfb2d019 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:30.672407 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-30610d28-d405-4794-b95b-c276dfb2d019 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:30.672827 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-30610d28-d405-4794-b95b-c276dfb2d019 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:30.676852 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-33e735b6-94f2-429d-bd29-2c8eccc95b15 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:30.677323 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-33e735b6-94f2-429d-bd29-2c8eccc95b15 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:30.678318 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-33e735b6-94f2-429d-bd29-2c8eccc95b15 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:30.678776 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-33e735b6-94f2-429d-bd29-2c8eccc95b15 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:30.709545 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-33e735b6-94f2-429d-bd29-2c8eccc95b15 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044546 Oct 28 12:16:30.710056 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 293/571] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:16:30 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:16:30.839318 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-49faab60-b611-471f-9267-8018627ca561 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:30.839952 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-49faab60-b611-471f-9267-8018627ca561 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:30.848368 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-49faab60-b611-471f-9267-8018627ca561 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:30.849142 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-49faab60-b611-471f-9267-8018627ca561 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:30.850011 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-49faab60-b611-471f-9267-8018627ca561 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:30.850437 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-49faab60-b611-471f-9267-8018627ca561 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:30.976007 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-49faab60-b611-471f-9267-8018627ca561 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:30.983709 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-49faab60-b611-471f-9267-8018627ca561 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1318 microversion: 2.1 time: 0.151251 Oct 28 12:16:30.984270 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 294/572] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:30 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:30.988341 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ebe29f13-8949-4b68-b48e-33608aa3a21e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:30.988931 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ebe29f13-8949-4b68-b48e-33608aa3a21e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:30.994207 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ebe29f13-8949-4b68-b48e-33608aa3a21e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:30.994743 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ebe29f13-8949-4b68-b48e-33608aa3a21e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:30.995562 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ebe29f13-8949-4b68-b48e-33608aa3a21e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:30.996050 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ebe29f13-8949-4b68-b48e-33608aa3a21e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:31.112140 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ebe29f13-8949-4b68-b48e-33608aa3a21e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:31.119280 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ebe29f13-8949-4b68-b48e-33608aa3a21e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1259 microversion: 2.1 time: 0.134097 Oct 28 12:16:31.119835 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 295/573] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:30 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1259 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:31.676346 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5b026166-c0a8-40a1-b54f-6efd15503da9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:31.676965 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5b026166-c0a8-40a1-b54f-6efd15503da9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:31.683358 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5b026166-c0a8-40a1-b54f-6efd15503da9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:31.683806 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5b026166-c0a8-40a1-b54f-6efd15503da9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:31.684574 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5b026166-c0a8-40a1-b54f-6efd15503da9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:31.685653 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5b026166-c0a8-40a1-b54f-6efd15503da9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:31.804808 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5b026166-c0a8-40a1-b54f-6efd15503da9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:31.812615 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5b026166-c0a8-40a1-b54f-6efd15503da9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1318 microversion: 2.1 time: 0.139930 Oct 28 12:16:31.813187 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 296/574] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:31 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:31.817473 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b87e13aa-1ae9-4054-940c-088640113680 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:31.818417 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b87e13aa-1ae9-4054-940c-088640113680 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:31.823805 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b87e13aa-1ae9-4054-940c-088640113680 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:31.824245 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b87e13aa-1ae9-4054-940c-088640113680 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:31.825012 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b87e13aa-1ae9-4054-940c-088640113680 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:31.825440 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b87e13aa-1ae9-4054-940c-088640113680 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:31.852764 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b87e13aa-1ae9-4054-940c-088640113680 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038583 Oct 28 12:16:31.853301 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 297/575] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:16:31 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:16:32.000891 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6c906f4b-e7d6-4779-8502-99dd29a57f32 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:32.001421 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6c906f4b-e7d6-4779-8502-99dd29a57f32 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:32.007304 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c906f4b-e7d6-4779-8502-99dd29a57f32 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:32.007753 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c906f4b-e7d6-4779-8502-99dd29a57f32 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:32.008513 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c906f4b-e7d6-4779-8502-99dd29a57f32 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:32.008944 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c906f4b-e7d6-4779-8502-99dd29a57f32 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:32.126605 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6c906f4b-e7d6-4779-8502-99dd29a57f32 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:32.133848 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6c906f4b-e7d6-4779-8502-99dd29a57f32 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1318 microversion: 2.1 time: 0.137106 Oct 28 12:16:32.134410 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 298/576] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:31 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:32.139240 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e036d482-6fef-4497-aee9-928d9d6f0c30 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:32.139836 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e036d482-6fef-4497-aee9-928d9d6f0c30 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:32.145214 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e036d482-6fef-4497-aee9-928d9d6f0c30 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:32.145659 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e036d482-6fef-4497-aee9-928d9d6f0c30 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:32.146420 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e036d482-6fef-4497-aee9-928d9d6f0c30 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:32.146891 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e036d482-6fef-4497-aee9-928d9d6f0c30 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:32.262554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e036d482-6fef-4497-aee9-928d9d6f0c30 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:32.270379 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e036d482-6fef-4497-aee9-928d9d6f0c30 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1259 microversion: 2.1 time: 0.134992 Oct 28 12:16:32.270977 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 299/577] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:32 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1259 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:32.829687 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e7a26d9f-acab-4f4c-a2ae-a2cddd9e5bc3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:32.830309 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e7a26d9f-acab-4f4c-a2ae-a2cddd9e5bc3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:32.836397 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7a26d9f-acab-4f4c-a2ae-a2cddd9e5bc3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:32.836846 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7a26d9f-acab-4f4c-a2ae-a2cddd9e5bc3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:32.837614 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7a26d9f-acab-4f4c-a2ae-a2cddd9e5bc3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:32.838051 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e7a26d9f-acab-4f4c-a2ae-a2cddd9e5bc3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:32.956237 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e7a26d9f-acab-4f4c-a2ae-a2cddd9e5bc3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:32.963325 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e7a26d9f-acab-4f4c-a2ae-a2cddd9e5bc3 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1318 microversion: 2.1 time: 0.137954 Oct 28 12:16:32.963888 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 300/578] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:32 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:32.968308 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-44fbc3c9-3a3e-4663-b973-05fc2b5760dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:32.969269 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-44fbc3c9-3a3e-4663-b973-05fc2b5760dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:32.974885 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-44fbc3c9-3a3e-4663-b973-05fc2b5760dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:32.975339 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-44fbc3c9-3a3e-4663-b973-05fc2b5760dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:32.976108 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-44fbc3c9-3a3e-4663-b973-05fc2b5760dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:32.976538 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-44fbc3c9-3a3e-4663-b973-05fc2b5760dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:33.004648 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-44fbc3c9-3a3e-4663-b973-05fc2b5760dc tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039767 Oct 28 12:16:33.005206 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 301/579] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:16:32 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:16:33.150753 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8d333d20-b405-4560-951e-e65dcdc05a58 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:33.151360 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8d333d20-b405-4560-951e-e65dcdc05a58 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:33.157154 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d333d20-b405-4560-951e-e65dcdc05a58 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:33.157598 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d333d20-b405-4560-951e-e65dcdc05a58 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:33.158362 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d333d20-b405-4560-951e-e65dcdc05a58 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:33.158818 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d333d20-b405-4560-951e-e65dcdc05a58 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:33.281661 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8d333d20-b405-4560-951e-e65dcdc05a58 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:33.288798 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8d333d20-b405-4560-951e-e65dcdc05a58 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1318 microversion: 2.1 time: 0.141698 Oct 28 12:16:33.289369 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 302/580] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:33 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:33.293489 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-197d3628-2412-4341-a704-96e366366c89 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:33.294563 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-197d3628-2412-4341-a704-96e366366c89 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:33.300132 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-197d3628-2412-4341-a704-96e366366c89 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:33.300572 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-197d3628-2412-4341-a704-96e366366c89 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:33.301334 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-197d3628-2412-4341-a704-96e366366c89 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:33.301766 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-197d3628-2412-4341-a704-96e366366c89 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:33.417791 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-197d3628-2412-4341-a704-96e366366c89 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:33.425749 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-197d3628-2412-4341-a704-96e366366c89 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1259 microversion: 2.1 time: 0.135444 Oct 28 12:16:33.426316 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 303/581] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:33 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1259 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:33.979634 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5a13942a-8edb-4c74-90d8-06ea0baa4c8f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:33.980261 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5a13942a-8edb-4c74-90d8-06ea0baa4c8f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:33.987901 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5a13942a-8edb-4c74-90d8-06ea0baa4c8f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:33.988344 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5a13942a-8edb-4c74-90d8-06ea0baa4c8f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:33.989114 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5a13942a-8edb-4c74-90d8-06ea0baa4c8f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:33.989571 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5a13942a-8edb-4c74-90d8-06ea0baa4c8f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:34.117110 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5a13942a-8edb-4c74-90d8-06ea0baa4c8f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:34.124987 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5a13942a-8edb-4c74-90d8-06ea0baa4c8f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1318 microversion: 2.1 time: 0.148937 Oct 28 12:16:34.125493 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 304/582] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:33 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:34.129727 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cb268d03-9c54-48cc-9e0f-fc5f81c4d0ff tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:34.130698 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cb268d03-9c54-48cc-9e0f-fc5f81c4d0ff tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:34.136090 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb268d03-9c54-48cc-9e0f-fc5f81c4d0ff tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:34.136524 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb268d03-9c54-48cc-9e0f-fc5f81c4d0ff tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:34.137330 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb268d03-9c54-48cc-9e0f-fc5f81c4d0ff tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:34.137743 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb268d03-9c54-48cc-9e0f-fc5f81c4d0ff tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:34.165596 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cb268d03-9c54-48cc-9e0f-fc5f81c4d0ff tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039135 Oct 28 12:16:34.166139 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 305/583] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:16:34 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:16:34.305728 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-57cec59f-0bca-4956-8e71-6521572b6bb9 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:34.306329 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-57cec59f-0bca-4956-8e71-6521572b6bb9 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:34.312654 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-57cec59f-0bca-4956-8e71-6521572b6bb9 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:34.313102 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-57cec59f-0bca-4956-8e71-6521572b6bb9 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:34.313859 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-57cec59f-0bca-4956-8e71-6521572b6bb9 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:34.314292 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-57cec59f-0bca-4956-8e71-6521572b6bb9 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:34.359509 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-30610d28-d405-4794-b95b-c276dfb2d019 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 3.699067 Oct 28 12:16:34.360162 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 279/584] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:30 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 3700 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:34.435924 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-57cec59f-0bca-4956-8e71-6521572b6bb9 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:34.443522 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-43a9c3f6-252b-4ff6-a05e-85d527258a80 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:34.444029 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-57cec59f-0bca-4956-8e71-6521572b6bb9 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1318 microversion: 2.1 time: 0.141934 Oct 28 12:16:34.444208 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-43a9c3f6-252b-4ff6-a05e-85d527258a80 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:34.444600 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 306/585] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:34 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:34.451169 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-43a9c3f6-252b-4ff6-a05e-85d527258a80 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:34.451608 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-43a9c3f6-252b-4ff6-a05e-85d527258a80 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:34.452925 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-43a9c3f6-252b-4ff6-a05e-85d527258a80 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:34.453346 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-43a9c3f6-252b-4ff6-a05e-85d527258a80 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:34.576645 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-43a9c3f6-252b-4ff6-a05e-85d527258a80 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:34.584233 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-43a9c3f6-252b-4ff6-a05e-85d527258a80 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1259 microversion: 2.1 time: 0.144622 Oct 28 12:16:34.584875 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 280/586] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:34 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:35.141024 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-64ad23f0-84b9-4cf0-bbb5-8306319a46f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:35.141661 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-64ad23f0-84b9-4cf0-bbb5-8306319a46f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:35.147916 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-64ad23f0-84b9-4cf0-bbb5-8306319a46f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:35.148369 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-64ad23f0-84b9-4cf0-bbb5-8306319a46f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:35.149133 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-64ad23f0-84b9-4cf0-bbb5-8306319a46f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:35.149565 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-64ad23f0-84b9-4cf0-bbb5-8306319a46f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:35.177857 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e4d6967e-e615-42ed-a91a-ceb6416f9b85 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:35.178809 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e4d6967e-e615-42ed-a91a-ceb6416f9b85 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:35.185031 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e4d6967e-e615-42ed-a91a-ceb6416f9b85 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:35.185483 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e4d6967e-e615-42ed-a91a-ceb6416f9b85 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:35.186253 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e4d6967e-e615-42ed-a91a-ceb6416f9b85 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:35.186701 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e4d6967e-e615-42ed-a91a-ceb6416f9b85 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:35.216189 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e4d6967e-e615-42ed-a91a-ceb6416f9b85 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042027 Oct 28 12:16:35.216742 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 281/587] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:16:35 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:16:35.273138 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-64ad23f0-84b9-4cf0-bbb5-8306319a46f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:35.280981 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-64ad23f0-84b9-4cf0-bbb5-8306319a46f5 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1318 microversion: 2.1 time: 0.142932 Oct 28 12:16:35.281537 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 307/588] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:35 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:35.370952 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0ab1336c-72c3-4e5a-bb8d-177309c3c0ee tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:35.371860 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0ab1336c-72c3-4e5a-bb8d-177309c3c0ee tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:35.378282 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0ab1336c-72c3-4e5a-bb8d-177309c3c0ee tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:35.378745 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0ab1336c-72c3-4e5a-bb8d-177309c3c0ee tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:35.379498 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0ab1336c-72c3-4e5a-bb8d-177309c3c0ee tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:35.379922 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0ab1336c-72c3-4e5a-bb8d-177309c3c0ee tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:35.461103 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-48d7b803-cb20-4333-ad7c-c55adc6e7980 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:35.461612 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-48d7b803-cb20-4333-ad7c-c55adc6e7980 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:35.467523 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-48d7b803-cb20-4333-ad7c-c55adc6e7980 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:35.467958 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-48d7b803-cb20-4333-ad7c-c55adc6e7980 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:35.468708 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-48d7b803-cb20-4333-ad7c-c55adc6e7980 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:35.469132 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-48d7b803-cb20-4333-ad7c-c55adc6e7980 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:35.489392 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0ab1336c-72c3-4e5a-bb8d-177309c3c0ee tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.121887 Oct 28 12:16:35.490981 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 282/589] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:35 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:16:35.604595 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ad4373e7-c489-447c-8bc4-f08e66b417bd tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:35.605622 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ad4373e7-c489-447c-8bc4-f08e66b417bd tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:35.613909 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad4373e7-c489-447c-8bc4-f08e66b417bd tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:35.614431 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad4373e7-c489-447c-8bc4-f08e66b417bd tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:35.618130 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-48d7b803-cb20-4333-ad7c-c55adc6e7980 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:35.624709 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad4373e7-c489-447c-8bc4-f08e66b417bd tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:35.625183 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad4373e7-c489-447c-8bc4-f08e66b417bd tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:35.628635 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-48d7b803-cb20-4333-ad7c-c55adc6e7980 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1318 microversion: 2.1 time: 0.171123 Oct 28 12:16:35.629220 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 308/590] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:35 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:35.767705 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ad4373e7-c489-447c-8bc4-f08e66b417bd tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:35.776098 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ad4373e7-c489-447c-8bc4-f08e66b417bd tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1259 microversion: 2.1 time: 0.175794 Oct 28 12:16:35.776973 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 283/591] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:35 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:36.208201 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-8cc8ce10-a55e-40de-9044-a9f2c258e7fc req-ccf513e3-82ea-4313-9f0c-58328daf8d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ebab3a-a58c-4216-862c-564d4d365c37", "name": "network-vif-plugged", "status": "completed", "tag": "1619934b-8d83-409a-9b55-2549b46519eb"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:36.209770 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:16:36.209770 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:16:36.217144 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-8cc8ce10-a55e-40de-9044-a9f2c258e7fc req-ccf513e3-82ea-4313-9f0c-58328daf8d38 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:36.217746 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-8cc8ce10-a55e-40de-9044-a9f2c258e7fc req-ccf513e3-82ea-4313-9f0c-58328daf8d38 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:36.228803 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-af5f7386-d988-4063-a8af-468f336abdc0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:36.229070 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-8cc8ce10-a55e-40de-9044-a9f2c258e7fc req-ccf513e3-82ea-4313-9f0c-58328daf8d38 service nova] Creating event network-vif-plugged:1619934b-8d83-409a-9b55-2549b46519eb for instance 15ebab3a-a58c-4216-862c-564d4d365c37 on hv-cinder-81571 Oct 28 12:16:36.230099 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-af5f7386-d988-4063-a8af-468f336abdc0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:36.234607 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-8cc8ce10-a55e-40de-9044-a9f2c258e7fc req-ccf513e3-82ea-4313-9f0c-58328daf8d38 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029996 Oct 28 12:16:36.235395 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 309/592] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:16:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:16:36.237325 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-af5f7386-d988-4063-a8af-468f336abdc0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:36.237908 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-af5f7386-d988-4063-a8af-468f336abdc0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:36.238706 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-af5f7386-d988-4063-a8af-468f336abdc0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:36.239211 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-af5f7386-d988-4063-a8af-468f336abdc0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:36.278109 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-af5f7386-d988-4063-a8af-468f336abdc0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053978 Oct 28 12:16:36.283391 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 284/593] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:16:36 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 12:16:36.298356 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9f36929c-0f20-4375-a48d-de4811f8b431 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:36.299237 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9f36929c-0f20-4375-a48d-de4811f8b431 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:36.306128 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9f36929c-0f20-4375-a48d-de4811f8b431 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:36.306708 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9f36929c-0f20-4375-a48d-de4811f8b431 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:36.307642 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9f36929c-0f20-4375-a48d-de4811f8b431 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:36.308178 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9f36929c-0f20-4375-a48d-de4811f8b431 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:36.496423 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9f36929c-0f20-4375-a48d-de4811f8b431 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:36.500922 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-47d34300-7ffb-4e6a-bb47-f6c9000216aa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:36.501831 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-47d34300-7ffb-4e6a-bb47-f6c9000216aa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:36.504393 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9f36929c-0f20-4375-a48d-de4811f8b431 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1509 microversion: 2.1 time: 0.210762 Oct 28 12:16:36.504971 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 310/594] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:36 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:36.508597 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47d34300-7ffb-4e6a-bb47-f6c9000216aa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:36.509046 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47d34300-7ffb-4e6a-bb47-f6c9000216aa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:36.509819 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47d34300-7ffb-4e6a-bb47-f6c9000216aa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:36.510249 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47d34300-7ffb-4e6a-bb47-f6c9000216aa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:36.645289 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-10885b92-9839-44c0-a82e-83f04c1b03b1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:36.645889 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-10885b92-9839-44c0-a82e-83f04c1b03b1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:36.651619 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-10885b92-9839-44c0-a82e-83f04c1b03b1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:36.652250 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-10885b92-9839-44c0-a82e-83f04c1b03b1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:36.652983 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-10885b92-9839-44c0-a82e-83f04c1b03b1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:36.653407 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-10885b92-9839-44c0-a82e-83f04c1b03b1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:36.784004 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-10885b92-9839-44c0-a82e-83f04c1b03b1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:36.792541 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-10885b92-9839-44c0-a82e-83f04c1b03b1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1318 microversion: 2.1 time: 0.150952 Oct 28 12:16:36.793171 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 311/595] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:36 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:36.797702 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b7b73b08-b14c-48b7-8571-355c5eec8fad tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:36.798366 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b7b73b08-b14c-48b7-8571-355c5eec8fad tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:36.804101 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b7b73b08-b14c-48b7-8571-355c5eec8fad tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:36.804632 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b7b73b08-b14c-48b7-8571-355c5eec8fad tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:36.805401 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b7b73b08-b14c-48b7-8571-355c5eec8fad tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:36.805834 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b7b73b08-b14c-48b7-8571-355c5eec8fad tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:36.834080 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-47d34300-7ffb-4e6a-bb47-f6c9000216aa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.336507 Oct 28 12:16:36.835101 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 285/596] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:36 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:16:36.933821 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b7b73b08-b14c-48b7-8571-355c5eec8fad tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:36.941237 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b7b73b08-b14c-48b7-8571-355c5eec8fad tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1259 microversion: 2.1 time: 0.147101 Oct 28 12:16:36.941805 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 312/597] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:36 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:37.809608 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7c4005b1-3edb-4037-ad73-9ba6f46d1fba tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:37.810152 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-36396e08-dde6-462b-8174-4c1bb6bde301 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3275ef98-888a-47fd-b732-c87c0ca92751"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:37.810522 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7c4005b1-3edb-4037-ad73-9ba6f46d1fba tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:37.811024 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-36396e08-dde6-462b-8174-4c1bb6bde301 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:37.818224 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7c4005b1-3edb-4037-ad73-9ba6f46d1fba tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:37.818486 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-36396e08-dde6-462b-8174-4c1bb6bde301 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:37.818753 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7c4005b1-3edb-4037-ad73-9ba6f46d1fba tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:37.819465 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-36396e08-dde6-462b-8174-4c1bb6bde301 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:37.819653 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7c4005b1-3edb-4037-ad73-9ba6f46d1fba tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:37.820075 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7c4005b1-3edb-4037-ad73-9ba6f46d1fba tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:37.820404 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-36396e08-dde6-462b-8174-4c1bb6bde301 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:37.820898 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-36396e08-dde6-462b-8174-4c1bb6bde301 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:37.968911 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7c4005b1-3edb-4037-ad73-9ba6f46d1fba tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:37.979771 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7c4005b1-3edb-4037-ad73-9ba6f46d1fba tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1318 microversion: 2.1 time: 0.173962 Oct 28 12:16:37.980345 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 286/598] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:37 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:37.986748 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-85c75823-db0a-4c9b-92c6-bc2558e75838 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:37.988451 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-85c75823-db0a-4c9b-92c6-bc2558e75838 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:37.994948 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-85c75823-db0a-4c9b-92c6-bc2558e75838 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:37.995538 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-85c75823-db0a-4c9b-92c6-bc2558e75838 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:37.996396 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-85c75823-db0a-4c9b-92c6-bc2558e75838 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:37.997073 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-85c75823-db0a-4c9b-92c6-bc2558e75838 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:38.086995 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-36396e08-dde6-462b-8174-4c1bb6bde301 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "POST /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281114 Oct 28 12:16:38.087677 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 313/599] 10.222.0.37 () {60 vars in 1322 bytes} [Thu Oct 28 12:16:37 2021] POST /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:16:38.093505 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-28ae31ae-d41b-4f8f-b06f-83d424b8244f tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:38.094267 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-28ae31ae-d41b-4f8f-b06f-83d424b8244f tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:38.100271 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-28ae31ae-d41b-4f8f-b06f-83d424b8244f tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:38.100721 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-28ae31ae-d41b-4f8f-b06f-83d424b8244f tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:38.101495 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-28ae31ae-d41b-4f8f-b06f-83d424b8244f tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:38.101929 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-28ae31ae-d41b-4f8f-b06f-83d424b8244f tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:38.122568 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-85c75823-db0a-4c9b-92c6-bc2558e75838 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.140391 Oct 28 12:16:38.128942 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 287/600] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:37 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:38.257287 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-28ae31ae-d41b-4f8f-b06f-83d424b8244f tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:38.267175 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-28ae31ae-d41b-4f8f-b06f-83d424b8244f tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1259 microversion: 2.1 time: 0.178287 Oct 28 12:16:38.267834 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 314/601] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:38 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:38.591759 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fc600e81-a4ff-454d-b35e-ea886e847563 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:38.592956 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fc600e81-a4ff-454d-b35e-ea886e847563 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:38.599655 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fc600e81-a4ff-454d-b35e-ea886e847563 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:38.600095 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fc600e81-a4ff-454d-b35e-ea886e847563 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:38.600877 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fc600e81-a4ff-454d-b35e-ea886e847563 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:38.601278 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fc600e81-a4ff-454d-b35e-ea886e847563 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:38.627418 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fc600e81-a4ff-454d-b35e-ea886e847563 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:16:38.713357 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fc600e81-a4ff-454d-b35e-ea886e847563 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "DELETE /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 204 len: 0 microversion: 2.1 time: 0.125391 Oct 28 12:16:38.713945 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 288/602] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:16:38 2021] DELETE /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:16:38.721801 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a974d354-d7a4-4277-9b72-e47c64d3845e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:38.722399 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a974d354-d7a4-4277-9b72-e47c64d3845e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:38.728488 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a974d354-d7a4-4277-9b72-e47c64d3845e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:38.728931 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a974d354-d7a4-4277-9b72-e47c64d3845e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:38.729722 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a974d354-d7a4-4277-9b72-e47c64d3845e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:38.730173 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a974d354-d7a4-4277-9b72-e47c64d3845e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:38.852654 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a974d354-d7a4-4277-9b72-e47c64d3845e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:38.859947 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a974d354-d7a4-4277-9b72-e47c64d3845e tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1508 microversion: 2.1 time: 0.141799 Oct 28 12:16:38.860507 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 315/603] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:38 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1508 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:38.997476 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-84def750-de68-44af-bd0e-f9ce28cc1345 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:38.998182 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-84def750-de68-44af-bd0e-f9ce28cc1345 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:39.005042 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-84def750-de68-44af-bd0e-f9ce28cc1345 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:39.005440 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-84def750-de68-44af-bd0e-f9ce28cc1345 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:39.006202 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-84def750-de68-44af-bd0e-f9ce28cc1345 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:39.006628 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-84def750-de68-44af-bd0e-f9ce28cc1345 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:39.130389 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-84def750-de68-44af-bd0e-f9ce28cc1345 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:39.135956 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3945c338-5da5-4c9f-aaa2-5abbb469e892 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:39.136911 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3945c338-5da5-4c9f-aaa2-5abbb469e892 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:39.138248 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-84def750-de68-44af-bd0e-f9ce28cc1345 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1508 microversion: 2.1 time: 0.144821 Oct 28 12:16:39.138836 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 289/604] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:38 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:39.142852 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3945c338-5da5-4c9f-aaa2-5abbb469e892 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:39.143298 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3945c338-5da5-4c9f-aaa2-5abbb469e892 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:39.144065 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3945c338-5da5-4c9f-aaa2-5abbb469e892 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:39.144497 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3945c338-5da5-4c9f-aaa2-5abbb469e892 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:39.216677 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3945c338-5da5-4c9f-aaa2-5abbb469e892 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.084133 Oct 28 12:16:39.217468 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 316/605] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:39 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:16:39.286022 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a3969226-cb2a-4aa4-b424-ae66c6efa947 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:39.286928 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a3969226-cb2a-4aa4-b424-ae66c6efa947 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:39.293198 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a3969226-cb2a-4aa4-b424-ae66c6efa947 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:39.293635 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a3969226-cb2a-4aa4-b424-ae66c6efa947 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:39.294395 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a3969226-cb2a-4aa4-b424-ae66c6efa947 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:39.294853 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a3969226-cb2a-4aa4-b424-ae66c6efa947 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:39.422363 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a3969226-cb2a-4aa4-b424-ae66c6efa947 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:39.430077 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a3969226-cb2a-4aa4-b424-ae66c6efa947 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1259 microversion: 2.1 time: 0.150142 Oct 28 12:16:39.430627 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 290/606] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:39 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:39.877179 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fc091dae-fab3-4b0c-9181-39a2ab00d30b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:39.877857 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fc091dae-fab3-4b0c-9181-39a2ab00d30b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:39.884610 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fc091dae-fab3-4b0c-9181-39a2ab00d30b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:39.885009 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fc091dae-fab3-4b0c-9181-39a2ab00d30b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:39.885886 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fc091dae-fab3-4b0c-9181-39a2ab00d30b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:39.886327 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fc091dae-fab3-4b0c-9181-39a2ab00d30b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:40.018639 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fc091dae-fab3-4b0c-9181-39a2ab00d30b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:40.026475 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fc091dae-fab3-4b0c-9181-39a2ab00d30b tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1508 microversion: 2.1 time: 0.153256 Oct 28 12:16:40.027085 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 317/607] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:39 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:40.227630 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3f8d98ff-beb5-4adc-8583-03806acc25a6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:40.228535 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3f8d98ff-beb5-4adc-8583-03806acc25a6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:40.234774 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3f8d98ff-beb5-4adc-8583-03806acc25a6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:40.235225 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3f8d98ff-beb5-4adc-8583-03806acc25a6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:40.235998 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3f8d98ff-beb5-4adc-8583-03806acc25a6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:40.236456 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3f8d98ff-beb5-4adc-8583-03806acc25a6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:40.306346 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3f8d98ff-beb5-4adc-8583-03806acc25a6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.082111 Oct 28 12:16:40.307025 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 291/608] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:40 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:40.447200 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ba98c1b2-05b3-4416-a769-b72ffdd7cb6a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:40.447804 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ba98c1b2-05b3-4416-a769-b72ffdd7cb6a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:40.456284 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba98c1b2-05b3-4416-a769-b72ffdd7cb6a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:40.456710 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba98c1b2-05b3-4416-a769-b72ffdd7cb6a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:40.457643 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba98c1b2-05b3-4416-a769-b72ffdd7cb6a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:40.458248 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba98c1b2-05b3-4416-a769-b72ffdd7cb6a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:40.578134 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ba98c1b2-05b3-4416-a769-b72ffdd7cb6a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:40.585437 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ba98c1b2-05b3-4416-a769-b72ffdd7cb6a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1259 microversion: 2.1 time: 0.142455 Oct 28 12:16:40.586038 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 318/609] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:40 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1259 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:41.044473 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-550e3435-8e50-47f2-b635-eb6c65d9ea4f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:41.045067 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-550e3435-8e50-47f2-b635-eb6c65d9ea4f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:41.052071 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-550e3435-8e50-47f2-b635-eb6c65d9ea4f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:41.052549 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-550e3435-8e50-47f2-b635-eb6c65d9ea4f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:41.053312 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-550e3435-8e50-47f2-b635-eb6c65d9ea4f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:41.053744 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-550e3435-8e50-47f2-b635-eb6c65d9ea4f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:41.181344 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-550e3435-8e50-47f2-b635-eb6c65d9ea4f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:41.189097 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-550e3435-8e50-47f2-b635-eb6c65d9ea4f tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1508 microversion: 2.1 time: 0.148708 Oct 28 12:16:41.189659 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 292/610] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:41 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:41.317906 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3b2946ee-c469-4b19-9b23-f17161ef23cc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:41.318758 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3b2946ee-c469-4b19-9b23-f17161ef23cc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:41.324913 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3b2946ee-c469-4b19-9b23-f17161ef23cc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:41.325468 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3b2946ee-c469-4b19-9b23-f17161ef23cc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:41.326267 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3b2946ee-c469-4b19-9b23-f17161ef23cc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:41.326720 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3b2946ee-c469-4b19-9b23-f17161ef23cc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:41.430336 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3b2946ee-c469-4b19-9b23-f17161ef23cc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.116010 Oct 28 12:16:41.431010 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 319/611] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:41 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:41.601221 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3a5a518c-0b82-4081-82a4-ad963c489b3d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:41.601756 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3a5a518c-0b82-4081-82a4-ad963c489b3d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:41.609429 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a5a518c-0b82-4081-82a4-ad963c489b3d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:41.609868 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a5a518c-0b82-4081-82a4-ad963c489b3d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:41.612203 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a5a518c-0b82-4081-82a4-ad963c489b3d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:41.612203 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a5a518c-0b82-4081-82a4-ad963c489b3d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:41.739851 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3a5a518c-0b82-4081-82a4-ad963c489b3d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:41.747039 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3a5a518c-0b82-4081-82a4-ad963c489b3d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1259 microversion: 2.1 time: 0.149580 Oct 28 12:16:41.747602 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 293/612] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:41 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:42.206643 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d8de7a9e-add1-4146-9f3f-b36de9bb2eac tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:42.207999 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d8de7a9e-add1-4146-9f3f-b36de9bb2eac tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:42.214546 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d8de7a9e-add1-4146-9f3f-b36de9bb2eac tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:42.215960 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d8de7a9e-add1-4146-9f3f-b36de9bb2eac tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:42.216890 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d8de7a9e-add1-4146-9f3f-b36de9bb2eac tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:42.218176 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d8de7a9e-add1-4146-9f3f-b36de9bb2eac tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:42.247539 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-57d77c85-2a1f-434d-83af-dfe1ebf0b972 req-6199fa92-83cb-47f4-8894-465645e8506b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c85f2863-bf90-49f5-a7cb-a13e366f1a0d", "name": "network-vif-deleted", "tag": "44584889-faf9-46d2-a381-15ee8d86d81a"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:42.249521 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:16:42.249521 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:16:42.258297 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-57d77c85-2a1f-434d-83af-dfe1ebf0b972 req-6199fa92-83cb-47f4-8894-465645e8506b service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:42.259191 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-57d77c85-2a1f-434d-83af-dfe1ebf0b972 req-6199fa92-83cb-47f4-8894-465645e8506b service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:42.273389 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-57d77c85-2a1f-434d-83af-dfe1ebf0b972 req-6199fa92-83cb-47f4-8894-465645e8506b service nova] Creating event network-vif-deleted:44584889-faf9-46d2-a381-15ee8d86d81a for instance c85f2863-bf90-49f5-a7cb-a13e366f1a0d on hv-cinder-81571 Oct 28 12:16:42.278841 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-57d77c85-2a1f-434d-83af-dfe1ebf0b972 req-6199fa92-83cb-47f4-8894-465645e8506b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035172 Oct 28 12:16:42.280803 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 294/613] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:16:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:16:42.300554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d8de7a9e-add1-4146-9f3f-b36de9bb2eac tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:42.309351 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d8de7a9e-add1-4146-9f3f-b36de9bb2eac tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 200 len: 1466 microversion: 2.1 time: 0.106723 Oct 28 12:16:42.310626 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 320/614] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:42 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 1466 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:42.442734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8b71918c-2916-496c-962d-002874c9d171 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:42.443645 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8b71918c-2916-496c-962d-002874c9d171 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:42.449966 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b71918c-2916-496c-962d-002874c9d171 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:42.450418 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b71918c-2916-496c-962d-002874c9d171 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:42.451265 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b71918c-2916-496c-962d-002874c9d171 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:42.452407 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8b71918c-2916-496c-962d-002874c9d171 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:42.559310 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8b71918c-2916-496c-962d-002874c9d171 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.120445 Oct 28 12:16:42.559957 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 295/615] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:42 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:42.763730 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4bbbdeee-138e-4078-80ba-47e047cd374f tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:42.764881 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4bbbdeee-138e-4078-80ba-47e047cd374f tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:42.771184 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4bbbdeee-138e-4078-80ba-47e047cd374f tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:42.771629 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4bbbdeee-138e-4078-80ba-47e047cd374f tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:42.772405 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4bbbdeee-138e-4078-80ba-47e047cd374f tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:42.772829 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4bbbdeee-138e-4078-80ba-47e047cd374f tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:42.921356 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4bbbdeee-138e-4078-80ba-47e047cd374f tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:42.929826 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4bbbdeee-138e-4078-80ba-47e047cd374f tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1259 microversion: 2.1 time: 0.169806 Oct 28 12:16:42.930396 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 321/616] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:42 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:43.328319 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fe68d049-e8fb-4da9-97cc-41ca53600a17 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:43.329004 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fe68d049-e8fb-4da9-97cc-41ca53600a17 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: c85f2863-bf90-49f5-a7cb-a13e366f1a0d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:43.335822 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe68d049-e8fb-4da9-97cc-41ca53600a17 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:43.336267 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe68d049-e8fb-4da9-97cc-41ca53600a17 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:43.337029 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe68d049-e8fb-4da9-97cc-41ca53600a17 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:43.337459 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe68d049-e8fb-4da9-97cc-41ca53600a17 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:43.356993 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-fe68d049-e8fb-4da9-97cc-41ca53600a17 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] HTTP exception thrown: Instance c85f2863-bf90-49f5-a7cb-a13e366f1a0d could not be found. Oct 28 12:16:43.357576 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fe68d049-e8fb-4da9-97cc-41ca53600a17 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Returning 404 to user: Instance c85f2863-bf90-49f5-a7cb-a13e366f1a0d could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:16:43.359770 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fe68d049-e8fb-4da9-97cc-41ca53600a17 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d" status: 404 len: 111 microversion: 2.1 time: 0.035056 Oct 28 12:16:43.359770 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 296/617] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:43 2021] GET /compute/v2.1/servers/c85f2863-bf90-49f5-a7cb-a13e366f1a0d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:16:43.367338 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5289e039-6294-4f05-bda9-38183629c3ae tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:43.367830 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5289e039-6294-4f05-bda9-38183629c3ae tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:43.374111 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5289e039-6294-4f05-bda9-38183629c3ae tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:43.374554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5289e039-6294-4f05-bda9-38183629c3ae tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:43.375349 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5289e039-6294-4f05-bda9-38183629c3ae tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:43.375777 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5289e039-6294-4f05-bda9-38183629c3ae tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:43.399623 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5289e039-6294-4f05-bda9-38183629c3ae tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:16:43.474375 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5289e039-6294-4f05-bda9-38183629c3ae tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "DELETE /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 204 len: 0 microversion: 2.1 time: 0.110316 Oct 28 12:16:43.475275 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 322/618] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:16:43 2021] DELETE /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:16:43.483639 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-40ec6554-bcd8-459f-ac34-b58fccf4feec tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:43.484243 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-40ec6554-bcd8-459f-ac34-b58fccf4feec tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:43.490419 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-40ec6554-bcd8-459f-ac34-b58fccf4feec tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:43.490923 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-40ec6554-bcd8-459f-ac34-b58fccf4feec tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:43.491687 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-40ec6554-bcd8-459f-ac34-b58fccf4feec tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:43.492118 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-40ec6554-bcd8-459f-ac34-b58fccf4feec tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:43.573487 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-828d1ea5-f394-4566-8019-9e66972a3ab9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:43.575076 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-828d1ea5-f394-4566-8019-9e66972a3ab9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:43.582486 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-828d1ea5-f394-4566-8019-9e66972a3ab9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:43.582902 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-828d1ea5-f394-4566-8019-9e66972a3ab9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:43.583683 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-828d1ea5-f394-4566-8019-9e66972a3ab9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:43.584108 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-828d1ea5-f394-4566-8019-9e66972a3ab9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:43.620491 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-40ec6554-bcd8-459f-ac34-b58fccf4feec tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:43.628394 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-40ec6554-bcd8-459f-ac34-b58fccf4feec tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.149070 Oct 28 12:16:43.628948 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 297/619] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:43 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:43.673767 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-828d1ea5-f394-4566-8019-9e66972a3ab9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.105561 Oct 28 12:16:43.674419 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 323/620] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:43 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:16:43.947353 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b3bf4887-99b1-43ba-9c22-943e0e2baca5 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:43.948319 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b3bf4887-99b1-43ba-9c22-943e0e2baca5 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:43.955935 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b3bf4887-99b1-43ba-9c22-943e0e2baca5 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:43.956457 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b3bf4887-99b1-43ba-9c22-943e0e2baca5 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:43.957303 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b3bf4887-99b1-43ba-9c22-943e0e2baca5 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:43.957799 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b3bf4887-99b1-43ba-9c22-943e0e2baca5 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:44.086351 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b3bf4887-99b1-43ba-9c22-943e0e2baca5 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:44.093617 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b3bf4887-99b1-43ba-9c22-943e0e2baca5 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1259 microversion: 2.1 time: 0.149925 Oct 28 12:16:44.094170 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 298/621] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:43 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:44.646368 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9254447c-a1af-4e17-9cea-241469651ff7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:44.647100 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9254447c-a1af-4e17-9cea-241469651ff7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:44.653935 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9254447c-a1af-4e17-9cea-241469651ff7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:44.654411 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9254447c-a1af-4e17-9cea-241469651ff7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:44.655202 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9254447c-a1af-4e17-9cea-241469651ff7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:44.655637 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9254447c-a1af-4e17-9cea-241469651ff7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:44.685249 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-744f8bde-66ab-419d-8507-7fcd3b7a52d0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:44.686574 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-744f8bde-66ab-419d-8507-7fcd3b7a52d0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:44.692644 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-744f8bde-66ab-419d-8507-7fcd3b7a52d0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:44.693084 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-744f8bde-66ab-419d-8507-7fcd3b7a52d0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:44.693843 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-744f8bde-66ab-419d-8507-7fcd3b7a52d0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:44.694262 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-744f8bde-66ab-419d-8507-7fcd3b7a52d0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:44.781154 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9254447c-a1af-4e17-9cea-241469651ff7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:44.788462 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9254447c-a1af-4e17-9cea-241469651ff7 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.146204 Oct 28 12:16:44.789116 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 324/622] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:44 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:44.801588 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-744f8bde-66ab-419d-8507-7fcd3b7a52d0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.119880 Oct 28 12:16:44.802217 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 299/623] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:44 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:16:45.109653 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-df008152-b5c5-4300-a055-047035e11370 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:45.110255 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-df008152-b5c5-4300-a055-047035e11370 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:45.116637 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-df008152-b5c5-4300-a055-047035e11370 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:45.117083 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-df008152-b5c5-4300-a055-047035e11370 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:45.117852 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-df008152-b5c5-4300-a055-047035e11370 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:45.118278 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-df008152-b5c5-4300-a055-047035e11370 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:45.257300 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-df008152-b5c5-4300-a055-047035e11370 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:45.265393 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-df008152-b5c5-4300-a055-047035e11370 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1259 microversion: 2.1 time: 0.159360 Oct 28 12:16:45.265991 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 325/624] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:45 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:45.654002 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e3e3079d-4a8a-4446-ad9f-63f97122e1dd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:45.654603 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e3e3079d-4a8a-4446-ad9f-63f97122e1dd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:45.661804 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e3e3079d-4a8a-4446-ad9f-63f97122e1dd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:45.662245 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e3e3079d-4a8a-4446-ad9f-63f97122e1dd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:45.663026 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e3e3079d-4a8a-4446-ad9f-63f97122e1dd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:45.663448 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e3e3079d-4a8a-4446-ad9f-63f97122e1dd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:45.742846 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-e3e3079d-4a8a-4446-ad9f-63f97122e1dd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lazy-loading 'services' on Instance uuid da336b35-558a-46d7-a7ca-9799568bbec3 {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:16:45.805618 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1b9cff00-08a9-4cb9-a646-aef6ceed9886 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:45.806243 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1b9cff00-08a9-4cb9-a646-aef6ceed9886 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:45.813730 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1b9cff00-08a9-4cb9-a646-aef6ceed9886 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:45.814180 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1b9cff00-08a9-4cb9-a646-aef6ceed9886 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:45.814982 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1b9cff00-08a9-4cb9-a646-aef6ceed9886 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:45.815417 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1b9cff00-08a9-4cb9-a646-aef6ceed9886 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:45.816329 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e3e3079d-4a8a-4446-ad9f-63f97122e1dd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "DELETE /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3/os-volume_attachments/3275ef98-888a-47fd-b732-c87c0ca92751" status: 202 len: 0 microversion: 2.1 time: 0.165971 Oct 28 12:16:45.820220 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 300/625] 10.222.0.37 () {58 vars in 1415 bytes} [Thu Oct 28 12:16:45 2021] DELETE /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3/os-volume_attachments/3275ef98-888a-47fd-b732-c87c0ca92751 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:45.823153 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5ed8093b-0d7e-488a-9d37-540ccb78505f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:45.823592 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5ed8093b-0d7e-488a-9d37-540ccb78505f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:45.829922 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5ed8093b-0d7e-488a-9d37-540ccb78505f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:45.830366 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5ed8093b-0d7e-488a-9d37-540ccb78505f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:45.831156 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5ed8093b-0d7e-488a-9d37-540ccb78505f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:45.831578 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5ed8093b-0d7e-488a-9d37-540ccb78505f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:45.929891 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5ed8093b-0d7e-488a-9d37-540ccb78505f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.111145 Oct 28 12:16:45.931305 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 301/626] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:45 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:45.938192 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8726af29-874a-4226-a91d-783ac70acb8c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:45.939313 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8726af29-874a-4226-a91d-783ac70acb8c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:45.959382 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1b9cff00-08a9-4cb9-a646-aef6ceed9886 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:45.960239 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8726af29-874a-4226-a91d-783ac70acb8c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:45.960565 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8726af29-874a-4226-a91d-783ac70acb8c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:45.961349 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8726af29-874a-4226-a91d-783ac70acb8c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:45.961776 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8726af29-874a-4226-a91d-783ac70acb8c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:45.967300 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1b9cff00-08a9-4cb9-a646-aef6ceed9886 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.165172 Oct 28 12:16:45.967953 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 326/627] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:45 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:45.993495 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8726af29-874a-4226-a91d-783ac70acb8c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060430 Oct 28 12:16:45.993959 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 302/628] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:16:45 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:16:46.282743 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b3204228-5ed2-4982-b076-6a25810eb89b tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:46.283432 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b3204228-5ed2-4982-b076-6a25810eb89b tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:46.289746 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3204228-5ed2-4982-b076-6a25810eb89b tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:46.290383 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3204228-5ed2-4982-b076-6a25810eb89b tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:46.291282 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3204228-5ed2-4982-b076-6a25810eb89b tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:46.291717 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3204228-5ed2-4982-b076-6a25810eb89b tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:46.421958 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b3204228-5ed2-4982-b076-6a25810eb89b tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:46.429407 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b3204228-5ed2-4982-b076-6a25810eb89b tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1259 microversion: 2.1 time: 0.150967 Oct 28 12:16:46.429972 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 327/629] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:46 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:46.942269 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-88bbf4c8-6ca1-46a1-be61-d76f917b2849 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:46.943192 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-88bbf4c8-6ca1-46a1-be61-d76f917b2849 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:46.949399 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-88bbf4c8-6ca1-46a1-be61-d76f917b2849 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:46.949838 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-88bbf4c8-6ca1-46a1-be61-d76f917b2849 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:46.950585 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-88bbf4c8-6ca1-46a1-be61-d76f917b2849 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:46.951032 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-88bbf4c8-6ca1-46a1-be61-d76f917b2849 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:46.984918 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-05847077-6c6f-4c7e-a55f-0166a01a9fb0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:46.985510 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-05847077-6c6f-4c7e-a55f-0166a01a9fb0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:46.991318 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05847077-6c6f-4c7e-a55f-0166a01a9fb0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:46.991755 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05847077-6c6f-4c7e-a55f-0166a01a9fb0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:46.992505 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05847077-6c6f-4c7e-a55f-0166a01a9fb0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:46.992925 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05847077-6c6f-4c7e-a55f-0166a01a9fb0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:47.024932 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-88bbf4c8-6ca1-46a1-be61-d76f917b2849 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.086236 Oct 28 12:16:47.025810 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 303/630] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:46 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:47.030546 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9510cc86-cabc-4b55-a068-8fcce6b9bd1a tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:47.031631 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9510cc86-cabc-4b55-a068-8fcce6b9bd1a tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:47.038497 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9510cc86-cabc-4b55-a068-8fcce6b9bd1a tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:47.038983 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9510cc86-cabc-4b55-a068-8fcce6b9bd1a tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:47.039754 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9510cc86-cabc-4b55-a068-8fcce6b9bd1a tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:47.040178 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9510cc86-cabc-4b55-a068-8fcce6b9bd1a tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:47.070213 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9510cc86-cabc-4b55-a068-8fcce6b9bd1a tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043460 Oct 28 12:16:47.071132 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 304/631] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:16:47 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:16:47.117971 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-05847077-6c6f-4c7e-a55f-0166a01a9fb0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:47.125699 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-05847077-6c6f-4c7e-a55f-0166a01a9fb0 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.144510 Oct 28 12:16:47.126474 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 328/632] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:46 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:47.445230 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c3d3cd5d-24ff-49a1-a247-324eedbf0188 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:47.445817 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c3d3cd5d-24ff-49a1-a247-324eedbf0188 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:47.452229 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3d3cd5d-24ff-49a1-a247-324eedbf0188 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:47.452671 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3d3cd5d-24ff-49a1-a247-324eedbf0188 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:47.453439 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3d3cd5d-24ff-49a1-a247-324eedbf0188 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:47.453868 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3d3cd5d-24ff-49a1-a247-324eedbf0188 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:47.582316 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c3d3cd5d-24ff-49a1-a247-324eedbf0188 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:47.589799 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c3d3cd5d-24ff-49a1-a247-324eedbf0188 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1259 microversion: 2.1 time: 0.148325 Oct 28 12:16:47.590362 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 305/633] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:47 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:48.036862 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-37474af8-4b36-4c9a-99de-bdcdc18c305d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:48.037673 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-37474af8-4b36-4c9a-99de-bdcdc18c305d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:48.044155 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-37474af8-4b36-4c9a-99de-bdcdc18c305d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:48.044613 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-37474af8-4b36-4c9a-99de-bdcdc18c305d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:48.045370 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-37474af8-4b36-4c9a-99de-bdcdc18c305d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:48.046048 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-37474af8-4b36-4c9a-99de-bdcdc18c305d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:48.082606 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b1f416e4-4b41-493d-b09b-93066cdb94e9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:48.083546 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b1f416e4-4b41-493d-b09b-93066cdb94e9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:48.089358 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b1f416e4-4b41-493d-b09b-93066cdb94e9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:48.089830 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b1f416e4-4b41-493d-b09b-93066cdb94e9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:48.090593 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b1f416e4-4b41-493d-b09b-93066cdb94e9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:48.091042 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b1f416e4-4b41-493d-b09b-93066cdb94e9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:48.112985 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-37474af8-4b36-4c9a-99de-bdcdc18c305d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.079880 Oct 28 12:16:48.114437 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 329/634] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:48 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:48.123721 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b1f416e4-4b41-493d-b09b-93066cdb94e9 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045223 Oct 28 12:16:48.124292 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 306/635] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:16:48 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 12:16:48.151076 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d1a7eaf4-a63c-4501-80f9-c096ef3d2ea5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:48.151767 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d1a7eaf4-a63c-4501-80f9-c096ef3d2ea5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:48.165334 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1a7eaf4-a63c-4501-80f9-c096ef3d2ea5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:48.165782 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1a7eaf4-a63c-4501-80f9-c096ef3d2ea5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:48.166560 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1a7eaf4-a63c-4501-80f9-c096ef3d2ea5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:48.167008 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1a7eaf4-a63c-4501-80f9-c096ef3d2ea5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:48.303809 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-8d368e1d-dfae-42cc-8e8c-3e3d105869df req-a619836f-9a65-4ffd-8bc1-294fbb037a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aa26e71-aa24-4d33-9b9f-96d11867d037", "name": "network-vif-plugged", "status": "completed", "tag": "6d493e72-8230-488e-974e-b32ede2a9db0"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:48.305062 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d1a7eaf4-a63c-4501-80f9-c096ef3d2ea5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:48.306245 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:16:48.306245 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:16:48.313345 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d1a7eaf4-a63c-4501-80f9-c096ef3d2ea5 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.172213 Oct 28 12:16:48.314188 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 330/636] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:48 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:48.315014 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-8d368e1d-dfae-42cc-8e8c-3e3d105869df req-a619836f-9a65-4ffd-8bc1-294fbb037a87 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:48.315588 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-8d368e1d-dfae-42cc-8e8c-3e3d105869df req-a619836f-9a65-4ffd-8bc1-294fbb037a87 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:48.327891 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-8d368e1d-dfae-42cc-8e8c-3e3d105869df req-a619836f-9a65-4ffd-8bc1-294fbb037a87 service nova] Creating event network-vif-plugged:6d493e72-8230-488e-974e-b32ede2a9db0 for instance 8aa26e71-aa24-4d33-9b9f-96d11867d037 on hv-cinder-81571 Oct 28 12:16:48.333087 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-8d368e1d-dfae-42cc-8e8c-3e3d105869df req-a619836f-9a65-4ffd-8bc1-294fbb037a87 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032957 Oct 28 12:16:48.333676 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 307/637] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:16:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:16:48.607086 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d7b47721-de66-4ad9-ae14-cd24336b737d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:48.608187 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d7b47721-de66-4ad9-ae14-cd24336b737d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:48.614610 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d7b47721-de66-4ad9-ae14-cd24336b737d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:48.615078 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d7b47721-de66-4ad9-ae14-cd24336b737d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:48.615832 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d7b47721-de66-4ad9-ae14-cd24336b737d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:48.616259 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d7b47721-de66-4ad9-ae14-cd24336b737d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:48.757856 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d7b47721-de66-4ad9-ae14-cd24336b737d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:48.765731 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d7b47721-de66-4ad9-ae14-cd24336b737d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1259 microversion: 2.1 time: 0.162618 Oct 28 12:16:48.766362 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 331/638] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:48 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:49.126964 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-42b0a31b-24f2-4b28-930e-ce923da8ed73 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:49.127888 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-42b0a31b-24f2-4b28-930e-ce923da8ed73 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:49.133885 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-42b0a31b-24f2-4b28-930e-ce923da8ed73 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:49.134325 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-42b0a31b-24f2-4b28-930e-ce923da8ed73 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:49.135131 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-42b0a31b-24f2-4b28-930e-ce923da8ed73 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:49.135559 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-42b0a31b-24f2-4b28-930e-ce923da8ed73 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:49.208098 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-42b0a31b-24f2-4b28-930e-ce923da8ed73 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.086130 Oct 28 12:16:49.209518 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 308/639] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:49 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:16:49.330440 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-53190735-646d-4727-a04c-edbc2bb48326 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:49.331074 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-53190735-646d-4727-a04c-edbc2bb48326 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:49.337323 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-53190735-646d-4727-a04c-edbc2bb48326 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:49.337768 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-53190735-646d-4727-a04c-edbc2bb48326 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:49.338533 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-53190735-646d-4727-a04c-edbc2bb48326 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:49.338998 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-53190735-646d-4727-a04c-edbc2bb48326 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:49.373172 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dea07708-0cab-478e-b316-41c7fd27f4c7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:49.373737 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dea07708-0cab-478e-b316-41c7fd27f4c7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:49.380660 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dea07708-0cab-478e-b316-41c7fd27f4c7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:49.381099 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dea07708-0cab-478e-b316-41c7fd27f4c7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:49.381864 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dea07708-0cab-478e-b316-41c7fd27f4c7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:49.382286 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dea07708-0cab-478e-b316-41c7fd27f4c7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:49.408712 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dea07708-0cab-478e-b316-41c7fd27f4c7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:16:49.468368 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-53190735-646d-4727-a04c-edbc2bb48326 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:49.475803 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-53190735-646d-4727-a04c-edbc2bb48326 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.149648 Oct 28 12:16:49.476455 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 332/640] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:49 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:49.490521 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dea07708-0cab-478e-b316-41c7fd27f4c7 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "DELETE /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 204 len: 0 microversion: 2.1 time: 0.120995 Oct 28 12:16:49.491459 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 309/641] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:16:49 2021] DELETE /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 12:16:49.499466 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c6c5fe5e-d568-4bf0-93f6-1252001fab17 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:49.500105 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c6c5fe5e-d568-4bf0-93f6-1252001fab17 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:49.506500 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6c5fe5e-d568-4bf0-93f6-1252001fab17 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:49.506971 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6c5fe5e-d568-4bf0-93f6-1252001fab17 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:49.507737 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6c5fe5e-d568-4bf0-93f6-1252001fab17 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:49.508160 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6c5fe5e-d568-4bf0-93f6-1252001fab17 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:49.628261 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c6c5fe5e-d568-4bf0-93f6-1252001fab17 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:49.635717 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c6c5fe5e-d568-4bf0-93f6-1252001fab17 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1515 microversion: 2.1 time: 0.140224 Oct 28 12:16:49.636334 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 333/642] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:49 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1515 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:49.784751 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-834727f0-6534-4376-804a-28bd3c05c446 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:49.786013 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-834727f0-6534-4376-804a-28bd3c05c446 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:49.795901 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-834727f0-6534-4376-804a-28bd3c05c446 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:49.796354 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-834727f0-6534-4376-804a-28bd3c05c446 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:49.797115 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-834727f0-6534-4376-804a-28bd3c05c446 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:49.797636 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-834727f0-6534-4376-804a-28bd3c05c446 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:49.928928 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-834727f0-6534-4376-804a-28bd3c05c446 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:49.936729 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-834727f0-6534-4376-804a-28bd3c05c446 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1259 microversion: 2.1 time: 0.157786 Oct 28 12:16:49.937288 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 310/643] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:49 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:50.221941 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c0655db1-83e4-4b56-a8d8-d552875d38f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:50.222835 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c0655db1-83e4-4b56-a8d8-d552875d38f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:50.229197 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0655db1-83e4-4b56-a8d8-d552875d38f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:50.229700 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0655db1-83e4-4b56-a8d8-d552875d38f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:50.230465 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0655db1-83e4-4b56-a8d8-d552875d38f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:50.230931 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0655db1-83e4-4b56-a8d8-d552875d38f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:50.335909 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c0655db1-83e4-4b56-a8d8-d552875d38f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.117460 Oct 28 12:16:50.336587 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 334/644] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:50 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:50.493071 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9d0fd914-8029-4984-a00d-1e77d95d927a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:50.493671 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9d0fd914-8029-4984-a00d-1e77d95d927a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:50.499922 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d0fd914-8029-4984-a00d-1e77d95d927a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:50.500363 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d0fd914-8029-4984-a00d-1e77d95d927a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:50.501122 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d0fd914-8029-4984-a00d-1e77d95d927a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:50.501551 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d0fd914-8029-4984-a00d-1e77d95d927a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:50.631760 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9d0fd914-8029-4984-a00d-1e77d95d927a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:50.640067 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9d0fd914-8029-4984-a00d-1e77d95d927a tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.150717 Oct 28 12:16:50.640620 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 311/645] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:50 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:50.653262 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5ed51898-3a5e-46cc-877d-2de8bba13683 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:50.653937 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5ed51898-3a5e-46cc-877d-2de8bba13683 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:50.660727 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ed51898-3a5e-46cc-877d-2de8bba13683 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:50.661159 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ed51898-3a5e-46cc-877d-2de8bba13683 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:50.661913 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ed51898-3a5e-46cc-877d-2de8bba13683 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:50.662335 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ed51898-3a5e-46cc-877d-2de8bba13683 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:50.790110 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5ed51898-3a5e-46cc-877d-2de8bba13683 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:50.800419 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5ed51898-3a5e-46cc-877d-2de8bba13683 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1515 microversion: 2.1 time: 0.150951 Oct 28 12:16:50.801001 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 335/646] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:50 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:50.953676 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-aa7e40fa-05e4-49c4-ba22-a3a332ddd2bf tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:50.954269 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-aa7e40fa-05e4-49c4-ba22-a3a332ddd2bf tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:50.960114 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aa7e40fa-05e4-49c4-ba22-a3a332ddd2bf tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:50.960548 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aa7e40fa-05e4-49c4-ba22-a3a332ddd2bf tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:50.961293 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aa7e40fa-05e4-49c4-ba22-a3a332ddd2bf tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:50.961713 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-aa7e40fa-05e4-49c4-ba22-a3a332ddd2bf tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:51.086194 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-aa7e40fa-05e4-49c4-ba22-a3a332ddd2bf tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:51.094080 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-aa7e40fa-05e4-49c4-ba22-a3a332ddd2bf tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1443 microversion: 2.1 time: 0.144746 Oct 28 12:16:51.094643 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 312/647] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:50 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1443 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:51.110154 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d9deeaed-041c-4187-9a9d-eb7eee2dc2c6 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:51.110788 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d9deeaed-041c-4187-9a9d-eb7eee2dc2c6 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:51.116976 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d9deeaed-041c-4187-9a9d-eb7eee2dc2c6 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:51.117420 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d9deeaed-041c-4187-9a9d-eb7eee2dc2c6 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:51.118184 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d9deeaed-041c-4187-9a9d-eb7eee2dc2c6 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:51.118617 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d9deeaed-041c-4187-9a9d-eb7eee2dc2c6 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:51.240360 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d9deeaed-041c-4187-9a9d-eb7eee2dc2c6 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:51.248721 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d9deeaed-041c-4187-9a9d-eb7eee2dc2c6 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1443 microversion: 2.1 time: 0.141840 Oct 28 12:16:51.249477 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 336/648] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:51 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1443 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:51.347908 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-97feb1df-89da-4bec-a82b-6822321934ac tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:51.348876 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-97feb1df-89da-4bec-a82b-6822321934ac tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:51.354750 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-97feb1df-89da-4bec-a82b-6822321934ac tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:51.355234 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-97feb1df-89da-4bec-a82b-6822321934ac tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:51.356132 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-97feb1df-89da-4bec-a82b-6822321934ac tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:51.356612 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-97feb1df-89da-4bec-a82b-6822321934ac tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:51.445958 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-97feb1df-89da-4bec-a82b-6822321934ac tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.101554 Oct 28 12:16:51.446623 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 313/649] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:51 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:16:51.656162 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ddd9d098-686d-4987-ac7c-14ad571fdedb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:51.656855 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ddd9d098-686d-4987-ac7c-14ad571fdedb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:51.663193 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ddd9d098-686d-4987-ac7c-14ad571fdedb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:51.663820 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ddd9d098-686d-4987-ac7c-14ad571fdedb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:51.664596 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ddd9d098-686d-4987-ac7c-14ad571fdedb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:51.665025 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ddd9d098-686d-4987-ac7c-14ad571fdedb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:51.818429 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b74286a2-8ee6-408c-8f7b-4a64ab363b60 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:51.819156 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b74286a2-8ee6-408c-8f7b-4a64ab363b60 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:51.826014 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b74286a2-8ee6-408c-8f7b-4a64ab363b60 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:51.830091 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b74286a2-8ee6-408c-8f7b-4a64ab363b60 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:51.830091 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b74286a2-8ee6-408c-8f7b-4a64ab363b60 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:51.830091 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b74286a2-8ee6-408c-8f7b-4a64ab363b60 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:51.857052 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ddd9d098-686d-4987-ac7c-14ad571fdedb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a0d06a4caa747218d2e4c7f96f90095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7674a1ffc684002a3b3e181e1e3ffd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:51.887481 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ddd9d098-686d-4987-ac7c-14ad571fdedb tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 200 len: 1521 microversion: 2.1 time: 0.232926 Oct 28 12:16:51.889783 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 337/650] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:51 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:51.963746 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-8da44e1b-fee6-4e3f-881b-dce78446f300 req-c8a3e85e-cb58-434c-b5b7-042a008fa807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b1cf11-e525-409b-83da-1c26e1d9937d", "name": "network-vif-deleted", "tag": "7fffbbcb-b6ac-4854-853b-b69ac56c5812"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:51.965352 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:16:51.965352 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:16:51.985762 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-8da44e1b-fee6-4e3f-881b-dce78446f300 req-c8a3e85e-cb58-434c-b5b7-042a008fa807 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:51.986506 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-8da44e1b-fee6-4e3f-881b-dce78446f300 req-c8a3e85e-cb58-434c-b5b7-042a008fa807 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:52.001019 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-8da44e1b-fee6-4e3f-881b-dce78446f300 req-c8a3e85e-cb58-434c-b5b7-042a008fa807 service nova] Creating event network-vif-deleted:7fffbbcb-b6ac-4854-853b-b69ac56c5812 for instance 28b1cf11-e525-409b-83da-1c26e1d9937d on hv-cinder-81571 Oct 28 12:16:52.012426 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-8da44e1b-fee6-4e3f-881b-dce78446f300 req-c8a3e85e-cb58-434c-b5b7-042a008fa807 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056804 Oct 28 12:16:52.013125 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 338/651] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:16:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:16:52.106010 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b74286a2-8ee6-408c-8f7b-4a64ab363b60 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:52.116541 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b74286a2-8ee6-408c-8f7b-4a64ab363b60 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1515 microversion: 2.1 time: 0.302517 Oct 28 12:16:52.117896 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 314/652] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:51 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1515 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:16:52.458652 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4f2aec1d-0391-4ae3-9fd7-f0d3844cb233 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:52.459757 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4f2aec1d-0391-4ae3-9fd7-f0d3844cb233 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:52.469298 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f2aec1d-0391-4ae3-9fd7-f0d3844cb233 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:52.469939 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f2aec1d-0391-4ae3-9fd7-f0d3844cb233 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:52.470759 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f2aec1d-0391-4ae3-9fd7-f0d3844cb233 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:52.471200 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4f2aec1d-0391-4ae3-9fd7-f0d3844cb233 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:52.550752 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4f2aec1d-0391-4ae3-9fd7-f0d3844cb233 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.096009 Oct 28 12:16:52.553126 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 339/653] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:52 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:52.907729 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-29c3b7b8-551d-4c32-8b47-52c0b4c87ed9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:52.908955 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-29c3b7b8-551d-4c32-8b47-52c0b4c87ed9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] [instance: 28b1cf11-e525-409b-83da-1c26e1d9937d] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:52.915963 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29c3b7b8-551d-4c32-8b47-52c0b4c87ed9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:52.917066 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29c3b7b8-551d-4c32-8b47-52c0b4c87ed9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:52.918148 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29c3b7b8-551d-4c32-8b47-52c0b4c87ed9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:52.918809 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29c3b7b8-551d-4c32-8b47-52c0b4c87ed9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:52.935070 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-29c3b7b8-551d-4c32-8b47-52c0b4c87ed9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] HTTP exception thrown: Instance 28b1cf11-e525-409b-83da-1c26e1d9937d could not be found. Oct 28 12:16:52.944559 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-29c3b7b8-551d-4c32-8b47-52c0b4c87ed9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] Returning 404 to user: Instance 28b1cf11-e525-409b-83da-1c26e1d9937d could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:16:52.946928 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-29c3b7b8-551d-4c32-8b47-52c0b4c87ed9 tempest-ServerRescueNegativeTestJSON-1580714644 tempest-ServerRescueNegativeTestJSON-1580714644-project] 10.222.0.37 "GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d" status: 404 len: 111 microversion: 2.1 time: 0.044808 Oct 28 12:16:52.948010 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 315/654] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:52 2021] GET /compute/v2.1/servers/28b1cf11-e525-409b-83da-1c26e1d9937d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:16:53.135319 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e8391ac5-8d7d-4489-b0a1-362f7a750715 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:53.136908 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e8391ac5-8d7d-4489-b0a1-362f7a750715 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:53.149394 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e8391ac5-8d7d-4489-b0a1-362f7a750715 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:53.150095 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e8391ac5-8d7d-4489-b0a1-362f7a750715 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:53.151089 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e8391ac5-8d7d-4489-b0a1-362f7a750715 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:53.151701 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e8391ac5-8d7d-4489-b0a1-362f7a750715 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:53.188682 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e8391ac5-8d7d-4489-b0a1-362f7a750715 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:53.189418 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e8391ac5-8d7d-4489-b0a1-362f7a750715 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:53.190273 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-e8391ac5-8d7d-4489-b0a1-362f7a750715 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lazy-loading 'fault' on Instance uuid da336b35-558a-46d7-a7ca-9799568bbec3 {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:16:53.262234 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e8391ac5-8d7d-4489-b0a1-362f7a750715 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:53.274782 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e8391ac5-8d7d-4489-b0a1-362f7a750715 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 200 len: 1308 microversion: 2.1 time: 0.143823 Oct 28 12:16:53.276381 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 340/655] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:53 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 1308 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:53.563565 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9ef88f7f-b36e-4acd-98bd-23b672cf9580 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:53.564839 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9ef88f7f-b36e-4acd-98bd-23b672cf9580 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:53.571087 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9ef88f7f-b36e-4acd-98bd-23b672cf9580 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:53.571515 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9ef88f7f-b36e-4acd-98bd-23b672cf9580 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:53.572538 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9ef88f7f-b36e-4acd-98bd-23b672cf9580 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:53.572991 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9ef88f7f-b36e-4acd-98bd-23b672cf9580 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:53.665908 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-85202166-12fc-4e9d-92fa-8d1e5b62fcf3 req-b1a34a0b-ba45-45e4-b774-34075fab4ead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aa26e71-aa24-4d33-9b9f-96d11867d037", "tag": "6d493e72-8230-488e-974e-b32ede2a9db0"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:53.668593 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:16:53.668593 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:16:53.679907 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-85202166-12fc-4e9d-92fa-8d1e5b62fcf3 req-b1a34a0b-ba45-45e4-b774-34075fab4ead service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:53.680249 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-85202166-12fc-4e9d-92fa-8d1e5b62fcf3 req-b1a34a0b-ba45-45e4-b774-34075fab4ead service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:53.691550 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-85202166-12fc-4e9d-92fa-8d1e5b62fcf3 req-b1a34a0b-ba45-45e4-b774-34075fab4ead service nova] Creating event network-changed:6d493e72-8230-488e-974e-b32ede2a9db0 for instance 8aa26e71-aa24-4d33-9b9f-96d11867d037 on hv-cinder-81571 Oct 28 12:16:53.696752 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-85202166-12fc-4e9d-92fa-8d1e5b62fcf3 req-b1a34a0b-ba45-45e4-b774-34075fab4ead service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036121 Oct 28 12:16:53.697891 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 341/656] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:16:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:16:53.771963 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9ef88f7f-b36e-4acd-98bd-23b672cf9580 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.211795 Oct 28 12:16:53.772599 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 316/657] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:53 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:54.092893 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-4bc1858b-7d97-4cd7-b5e8-669cce7a6337 req-524df5f5-e6d2-4d8f-bb43-bb82ad1e98ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da336b35-558a-46d7-a7ca-9799568bbec3", "name": "network-vif-deleted", "tag": "cb078e40-acbe-40fd-aa54-76513a780403"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:54.094635 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:16:54.094635 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:16:54.102351 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-4bc1858b-7d97-4cd7-b5e8-669cce7a6337 req-524df5f5-e6d2-4d8f-bb43-bb82ad1e98ed service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:54.102942 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-4bc1858b-7d97-4cd7-b5e8-669cce7a6337 req-524df5f5-e6d2-4d8f-bb43-bb82ad1e98ed service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:54.114429 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-4bc1858b-7d97-4cd7-b5e8-669cce7a6337 req-524df5f5-e6d2-4d8f-bb43-bb82ad1e98ed service nova] Creating event network-vif-deleted:cb078e40-acbe-40fd-aa54-76513a780403 for instance da336b35-558a-46d7-a7ca-9799568bbec3 on hv-cinder-81571 Oct 28 12:16:54.119500 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-4bc1858b-7d97-4cd7-b5e8-669cce7a6337 req-524df5f5-e6d2-4d8f-bb43-bb82ad1e98ed service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031224 Oct 28 12:16:54.120543 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 342/658] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:16:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:16:54.293362 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b9cdfa73-f29e-4a54-8f82-3aa86d4db358 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:54.294379 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b9cdfa73-f29e-4a54-8f82-3aa86d4db358 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: da336b35-558a-46d7-a7ca-9799568bbec3] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:54.302102 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b9cdfa73-f29e-4a54-8f82-3aa86d4db358 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:54.302705 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b9cdfa73-f29e-4a54-8f82-3aa86d4db358 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:54.303756 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b9cdfa73-f29e-4a54-8f82-3aa86d4db358 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:54.304404 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b9cdfa73-f29e-4a54-8f82-3aa86d4db358 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:54.318815 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-b9cdfa73-f29e-4a54-8f82-3aa86d4db358 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] HTTP exception thrown: Instance da336b35-558a-46d7-a7ca-9799568bbec3 could not be found. Oct 28 12:16:54.319532 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b9cdfa73-f29e-4a54-8f82-3aa86d4db358 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Returning 404 to user: Instance da336b35-558a-46d7-a7ca-9799568bbec3 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:16:54.320431 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b9cdfa73-f29e-4a54-8f82-3aa86d4db358 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3" status: 404 len: 111 microversion: 2.1 time: 0.031233 Oct 28 12:16:54.321049 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 317/659] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:54 2021] GET /compute/v2.1/servers/da336b35-558a-46d7-a7ca-9799568bbec3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:16:54.785048 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-08e5f66b-c529-4b2a-b811-1b2e4f21edcf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:54.785968 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-08e5f66b-c529-4b2a-b811-1b2e4f21edcf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:54.792406 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-08e5f66b-c529-4b2a-b811-1b2e4f21edcf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:54.792859 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-08e5f66b-c529-4b2a-b811-1b2e4f21edcf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:54.793640 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-08e5f66b-c529-4b2a-b811-1b2e4f21edcf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:54.794066 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-08e5f66b-c529-4b2a-b811-1b2e4f21edcf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:54.869545 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-08e5f66b-c529-4b2a-b811-1b2e4f21edcf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.088518 Oct 28 12:16:54.870849 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 343/660] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:54 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:55.471482 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a121aa27-2b5d-47d8-ba5c-80d40e2350cb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:55.472468 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a121aa27-2b5d-47d8-ba5c-80d40e2350cb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:55.479267 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a121aa27-2b5d-47d8-ba5c-80d40e2350cb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:55.479708 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a121aa27-2b5d-47d8-ba5c-80d40e2350cb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:55.480685 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a121aa27-2b5d-47d8-ba5c-80d40e2350cb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:55.480891 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a121aa27-2b5d-47d8-ba5c-80d40e2350cb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:55.511357 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a121aa27-2b5d-47d8-ba5c-80d40e2350cb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:16:55.611277 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a121aa27-2b5d-47d8-ba5c-80d40e2350cb tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "DELETE /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 204 len: 0 microversion: 2.1 time: 0.143485 Oct 28 12:16:55.614850 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 318/661] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:16:55 2021] DELETE /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:16:55.620724 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fe91657d-edea-4f93-ae52-e105a01e6c32 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:55.621502 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fe91657d-edea-4f93-ae52-e105a01e6c32 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:55.628684 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe91657d-edea-4f93-ae52-e105a01e6c32 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:55.629391 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe91657d-edea-4f93-ae52-e105a01e6c32 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:55.630370 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe91657d-edea-4f93-ae52-e105a01e6c32 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:55.630927 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe91657d-edea-4f93-ae52-e105a01e6c32 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:55.774029 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fe91657d-edea-4f93-ae52-e105a01e6c32 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:55.782453 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fe91657d-edea-4f93-ae52-e105a01e6c32 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1513 microversion: 2.1 time: 0.166134 Oct 28 12:16:55.783157 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 344/662] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:55 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:55.882188 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-29741e59-b334-4961-a6f3-b65be3209ce2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:55.883239 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-29741e59-b334-4961-a6f3-b65be3209ce2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:55.890312 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29741e59-b334-4961-a6f3-b65be3209ce2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:55.891074 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29741e59-b334-4961-a6f3-b65be3209ce2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:55.892067 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29741e59-b334-4961-a6f3-b65be3209ce2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:55.892502 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29741e59-b334-4961-a6f3-b65be3209ce2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:55.967263 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-29741e59-b334-4961-a6f3-b65be3209ce2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.089102 Oct 28 12:16:55.971277 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 319/663] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:55 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:56.800719 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d4141ea4-a404-4fa9-9647-3d48abdef79c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:56.801438 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d4141ea4-a404-4fa9-9647-3d48abdef79c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:56.807904 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d4141ea4-a404-4fa9-9647-3d48abdef79c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:56.808347 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d4141ea4-a404-4fa9-9647-3d48abdef79c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:56.809121 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d4141ea4-a404-4fa9-9647-3d48abdef79c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:56.809553 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d4141ea4-a404-4fa9-9647-3d48abdef79c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:56.980226 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-54e69f39-a399-43bc-9595-76536e6ee46a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:56.981376 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-54e69f39-a399-43bc-9595-76536e6ee46a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:56.988914 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d4141ea4-a404-4fa9-9647-3d48abdef79c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:56.992963 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54e69f39-a399-43bc-9595-76536e6ee46a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:56.993441 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54e69f39-a399-43bc-9595-76536e6ee46a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:56.994221 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54e69f39-a399-43bc-9595-76536e6ee46a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:56.994652 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54e69f39-a399-43bc-9595-76536e6ee46a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:56.996967 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d4141ea4-a404-4fa9-9647-3d48abdef79c tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1513 microversion: 2.1 time: 0.200193 Oct 28 12:16:56.997609 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 345/664] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:56 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:57.067130 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-54e69f39-a399-43bc-9595-76536e6ee46a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.091361 Oct 28 12:16:57.067836 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 320/665] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:56 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:16:58.015136 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6572c45f-c66c-4c61-b834-911b0d5767d1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:58.016783 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6572c45f-c66c-4c61-b834-911b0d5767d1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:58.023000 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6572c45f-c66c-4c61-b834-911b0d5767d1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:58.023526 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6572c45f-c66c-4c61-b834-911b0d5767d1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:58.024304 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6572c45f-c66c-4c61-b834-911b0d5767d1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:58.024733 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6572c45f-c66c-4c61-b834-911b0d5767d1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:58.081314 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2afbb90a-1f5a-4e4f-ac95-e15834d7c706 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:58.083605 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2afbb90a-1f5a-4e4f-ac95-e15834d7c706 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:58.096208 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2afbb90a-1f5a-4e4f-ac95-e15834d7c706 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:58.096656 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2afbb90a-1f5a-4e4f-ac95-e15834d7c706 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:58.097432 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2afbb90a-1f5a-4e4f-ac95-e15834d7c706 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:58.098027 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2afbb90a-1f5a-4e4f-ac95-e15834d7c706 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:58.172111 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2afbb90a-1f5a-4e4f-ac95-e15834d7c706 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.096089 Oct 28 12:16:58.176023 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 321/666] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:58 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:16:58.252855 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6572c45f-c66c-4c61-b834-911b0d5767d1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:16:58.264179 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6572c45f-c66c-4c61-b834-911b0d5767d1 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 200 len: 1513 microversion: 2.1 time: 0.253188 Oct 28 12:16:58.265689 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 346/667] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:58 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 1513 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:16:58.593454 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-407e6af5-f956-4cce-87a0-85e0887e0b55 req-d9156813-08f5-4569-a0c6-9b18be2205eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "948c9fed-b55d-4b55-9971-f4db721088aa", "name": "network-vif-deleted", "tag": "1391e735-fffa-4d34-9821-38ee846f2984"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:58.595079 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:16:58.595079 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:16:58.604345 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-407e6af5-f956-4cce-87a0-85e0887e0b55 req-d9156813-08f5-4569-a0c6-9b18be2205eb service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:58.604785 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-407e6af5-f956-4cce-87a0-85e0887e0b55 req-d9156813-08f5-4569-a0c6-9b18be2205eb service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:58.634338 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-407e6af5-f956-4cce-87a0-85e0887e0b55 req-d9156813-08f5-4569-a0c6-9b18be2205eb service nova] Creating event network-vif-deleted:1391e735-fffa-4d34-9821-38ee846f2984 for instance 948c9fed-b55d-4b55-9971-f4db721088aa on hv-cinder-81571 Oct 28 12:16:58.640012 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-407e6af5-f956-4cce-87a0-85e0887e0b55 req-d9156813-08f5-4569-a0c6-9b18be2205eb service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051602 Oct 28 12:16:58.641220 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 322/668] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:16:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:16:59.184993 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e1ad4712-f921-44b1-a066-64209420d9af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:16:59.186522 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e1ad4712-f921-44b1-a066-64209420d9af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:59.193551 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e1ad4712-f921-44b1-a066-64209420d9af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:59.194199 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e1ad4712-f921-44b1-a066-64209420d9af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:59.195247 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e1ad4712-f921-44b1-a066-64209420d9af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:59.195833 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e1ad4712-f921-44b1-a066-64209420d9af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:59.278336 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e1ad4712-f921-44b1-a066-64209420d9af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.097818 Oct 28 12:16:59.280381 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 347/669] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:16:59 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:16:59.287088 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-da496b4c-8754-4979-a530-b346c6ca873b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:59.288311 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-da496b4c-8754-4979-a530-b346c6ca873b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 948c9fed-b55d-4b55-9971-f4db721088aa] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:59.294301 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da496b4c-8754-4979-a530-b346c6ca873b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:59.294864 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da496b4c-8754-4979-a530-b346c6ca873b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:59.295917 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da496b4c-8754-4979-a530-b346c6ca873b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:59.296677 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da496b4c-8754-4979-a530-b346c6ca873b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:59.311170 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-da496b4c-8754-4979-a530-b346c6ca873b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] HTTP exception thrown: Instance 948c9fed-b55d-4b55-9971-f4db721088aa could not be found. Oct 28 12:16:59.312036 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-da496b4c-8754-4979-a530-b346c6ca873b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Returning 404 to user: Instance 948c9fed-b55d-4b55-9971-f4db721088aa could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:16:59.312854 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-da496b4c-8754-4979-a530-b346c6ca873b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa" status: 404 len: 111 microversion: 2.1 time: 0.034690 Oct 28 12:16:59.313700 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 323/670] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:59 2021] GET /compute/v2.1/servers/948c9fed-b55d-4b55-9971-f4db721088aa => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 12:16:59.323084 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6724d570-9711-4987-9534-a8dfb0b2d229 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:59.323579 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6724d570-9711-4987-9534-a8dfb0b2d229 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:59.331005 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6724d570-9711-4987-9534-a8dfb0b2d229 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:59.331893 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6724d570-9711-4987-9534-a8dfb0b2d229 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:59.332726 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6724d570-9711-4987-9534-a8dfb0b2d229 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:59.333314 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6724d570-9711-4987-9534-a8dfb0b2d229 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:59.370302 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6724d570-9711-4987-9534-a8dfb0b2d229 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:16:59.467203 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6724d570-9711-4987-9534-a8dfb0b2d229 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "DELETE /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 204 len: 0 microversion: 2.1 time: 0.148825 Oct 28 12:16:59.470849 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 348/671] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:16:59 2021] DELETE /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:16:59.477744 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-404a3cec-9ed0-4b67-a8d2-85977ab16427 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:16:59.478359 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-404a3cec-9ed0-4b67-a8d2-85977ab16427 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:16:59.490857 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-404a3cec-9ed0-4b67-a8d2-85977ab16427 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:59.491572 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-404a3cec-9ed0-4b67-a8d2-85977ab16427 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:16:59.492574 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-404a3cec-9ed0-4b67-a8d2-85977ab16427 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:16:59.493248 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-404a3cec-9ed0-4b67-a8d2-85977ab16427 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:00.029888 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-404a3cec-9ed0-4b67-a8d2-85977ab16427 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:00.039479 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-404a3cec-9ed0-4b67-a8d2-85977ab16427 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1514 microversion: 2.1 time: 0.566580 Oct 28 12:17:00.040057 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 324/672] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:16:59 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1514 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:00.291862 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-88ee1699-9a7a-46ae-88a4-5b9f96586cef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:00.293480 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-88ee1699-9a7a-46ae-88a4-5b9f96586cef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:00.300360 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-88ee1699-9a7a-46ae-88a4-5b9f96586cef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:00.300813 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-88ee1699-9a7a-46ae-88a4-5b9f96586cef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:00.301590 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-88ee1699-9a7a-46ae-88a4-5b9f96586cef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:00.302014 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-88ee1699-9a7a-46ae-88a4-5b9f96586cef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:00.379980 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-88ee1699-9a7a-46ae-88a4-5b9f96586cef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.092309 Oct 28 12:17:00.381215 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 349/673] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:17:00 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:17:01.056820 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3410acc0-2791-40ea-bb0a-b3849c222804 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:01.057596 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3410acc0-2791-40ea-bb0a-b3849c222804 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:01.064663 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3410acc0-2791-40ea-bb0a-b3849c222804 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:01.065266 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3410acc0-2791-40ea-bb0a-b3849c222804 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:01.066159 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3410acc0-2791-40ea-bb0a-b3849c222804 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:01.066715 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3410acc0-2791-40ea-bb0a-b3849c222804 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:01.210441 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3410acc0-2791-40ea-bb0a-b3849c222804 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:01.221640 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3410acc0-2791-40ea-bb0a-b3849c222804 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1514 microversion: 2.1 time: 0.168455 Oct 28 12:17:01.222615 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 325/674] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:01 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:01.392801 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b514cbcc-149c-4ebe-84bd-fd5db76ade6c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:01.395287 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b514cbcc-149c-4ebe-84bd-fd5db76ade6c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:01.402445 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b514cbcc-149c-4ebe-84bd-fd5db76ade6c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:01.403219 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b514cbcc-149c-4ebe-84bd-fd5db76ade6c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:01.405559 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b514cbcc-149c-4ebe-84bd-fd5db76ade6c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:01.405884 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b514cbcc-149c-4ebe-84bd-fd5db76ade6c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:01.489084 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b514cbcc-149c-4ebe-84bd-fd5db76ade6c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.101130 Oct 28 12:17:01.490174 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 350/675] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:17:01 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:17:02.239026 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4e2b797d-b646-41f0-b43c-66b9db57df5b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:02.239631 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4e2b797d-b646-41f0-b43c-66b9db57df5b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:02.247492 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e2b797d-b646-41f0-b43c-66b9db57df5b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:02.248993 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e2b797d-b646-41f0-b43c-66b9db57df5b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:02.250112 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e2b797d-b646-41f0-b43c-66b9db57df5b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:02.250614 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e2b797d-b646-41f0-b43c-66b9db57df5b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:02.319666 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4e2b797d-b646-41f0-b43c-66b9db57df5b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:02.327919 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4e2b797d-b646-41f0-b43c-66b9db57df5b tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 200 len: 1472 microversion: 2.1 time: 0.092403 Oct 28 12:17:02.340723 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 326/676] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:02 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 1472 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:02.393331 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-bd546b86-14c2-425e-a05f-c30ebf2b84cb req-1cf4fc88-b383-4b9f-be5f-98a4d2fb2e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dad0a53-4ae8-40dc-a10f-acae9a07424a", "name": "network-vif-deleted", "tag": "3f38fef4-b0dd-45df-aeed-6c7e40ac2d57"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:02.398806 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:17:02.398806 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:17:02.411914 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-bd546b86-14c2-425e-a05f-c30ebf2b84cb req-1cf4fc88-b383-4b9f-be5f-98a4d2fb2e64 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:02.412630 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-bd546b86-14c2-425e-a05f-c30ebf2b84cb req-1cf4fc88-b383-4b9f-be5f-98a4d2fb2e64 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:02.426946 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-bd546b86-14c2-425e-a05f-c30ebf2b84cb req-1cf4fc88-b383-4b9f-be5f-98a4d2fb2e64 service nova] Creating event network-vif-deleted:3f38fef4-b0dd-45df-aeed-6c7e40ac2d57 for instance 7dad0a53-4ae8-40dc-a10f-acae9a07424a on hv-cinder-81571 Oct 28 12:17:02.433473 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-bd546b86-14c2-425e-a05f-c30ebf2b84cb req-1cf4fc88-b383-4b9f-be5f-98a4d2fb2e64 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044809 Oct 28 12:17:02.434362 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 351/677] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:17:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:17:02.501555 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f219985b-007c-4e7a-b37f-cc6bfee27609 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:02.502584 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f219985b-007c-4e7a-b37f-cc6bfee27609 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:02.517260 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f219985b-007c-4e7a-b37f-cc6bfee27609 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:02.520377 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f219985b-007c-4e7a-b37f-cc6bfee27609 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:02.521320 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f219985b-007c-4e7a-b37f-cc6bfee27609 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:02.521861 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f219985b-007c-4e7a-b37f-cc6bfee27609 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:02.625240 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f219985b-007c-4e7a-b37f-cc6bfee27609 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.128023 Oct 28 12:17:02.626067 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 327/678] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:17:02 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:17:03.254952 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0008936a-a0fa-4371-8f01-15a1e92dcdde tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'create', calling method: .version_select at 0x7f11f81c4f70>, body: {"keypair": {"name": "tempest-keypair-104121"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:03.274666 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-0008936a-a0fa-4371-8f01-15a1e92dcdde tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Getting quotas for project 9312b8e64f51472da613ba9a553d6c08. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:17:03.278930 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-0008936a-a0fa-4371-8f01-15a1e92dcdde tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Getting quotas for user 32e4266183744daea8c01bd9f3b503e1 and project 9312b8e64f51472da613ba9a553d6c08. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:17:03.348583 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8df61081-b09d-49f5-8adb-b158d07ccf63 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:03.349280 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8df61081-b09d-49f5-8adb-b158d07ccf63 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 7dad0a53-4ae8-40dc-a10f-acae9a07424a] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:03.359990 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8df61081-b09d-49f5-8adb-b158d07ccf63 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:03.360442 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8df61081-b09d-49f5-8adb-b158d07ccf63 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:03.361230 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8df61081-b09d-49f5-8adb-b158d07ccf63 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:03.361664 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8df61081-b09d-49f5-8adb-b158d07ccf63 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:03.377600 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-8df61081-b09d-49f5-8adb-b158d07ccf63 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] HTTP exception thrown: Instance 7dad0a53-4ae8-40dc-a10f-acae9a07424a could not be found. Oct 28 12:17:03.378095 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8df61081-b09d-49f5-8adb-b158d07ccf63 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Returning 404 to user: Instance 7dad0a53-4ae8-40dc-a10f-acae9a07424a could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:17:03.378943 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8df61081-b09d-49f5-8adb-b158d07ccf63 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a" status: 404 len: 111 microversion: 2.1 time: 0.034560 Oct 28 12:17:03.379487 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 328/679] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:03 2021] GET /compute/v2.1/servers/7dad0a53-4ae8-40dc-a10f-acae9a07424a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 12:17:03.526523 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-0008936a-a0fa-4371-8f01-15a1e92dcdde tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Getting quotas for project 9312b8e64f51472da613ba9a553d6c08. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:17:03.530212 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-0008936a-a0fa-4371-8f01-15a1e92dcdde tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Getting quotas for user 32e4266183744daea8c01bd9f3b503e1 and project 9312b8e64f51472da613ba9a553d6c08. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:17:03.550670 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0008936a-a0fa-4371-8f01-15a1e92dcdde tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2297 microversion: 2.1 time: 0.433676 Oct 28 12:17:03.551497 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 352/680] 10.222.0.37 () {60 vars in 1157 bytes} [Thu Oct 28 12:17:03 2021] POST /compute/v2.1/os-keypairs => generated 2297 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:03.636993 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9d42b6fb-e690-4bfe-aaef-0589eee756d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:03.638381 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9d42b6fb-e690-4bfe-aaef-0589eee756d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:03.645125 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d42b6fb-e690-4bfe-aaef-0589eee756d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:03.645686 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d42b6fb-e690-4bfe-aaef-0589eee756d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:03.646670 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d42b6fb-e690-4bfe-aaef-0589eee756d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:03.647330 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d42b6fb-e690-4bfe-aaef-0589eee756d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:03.724949 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9d42b6fb-e690-4bfe-aaef-0589eee756d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 28648 microversion: 2.20 time: 0.091579 Oct 28 12:17:03.725939 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 329/681] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:17:03 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 28648 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:17:04.736862 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-afec93cb-031c-4317-9b14-5888eca7f136 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:04.738749 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-afec93cb-031c-4317-9b14-5888eca7f136 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:04.745554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-afec93cb-031c-4317-9b14-5888eca7f136 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:04.746394 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-afec93cb-031c-4317-9b14-5888eca7f136 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:04.747977 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-afec93cb-031c-4317-9b14-5888eca7f136 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:04.748465 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-afec93cb-031c-4317-9b14-5888eca7f136 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:04.840083 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-afec93cb-031c-4317-9b14-5888eca7f136 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 29331 microversion: 2.20 time: 0.107381 Oct 28 12:17:04.841134 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 353/682] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:17:04 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 29331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:17:04.913104 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-eec6c326-ac42-4141-b6b2-dcc1f0e34a53 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1452534155", "imageRef": "4385a199-a3e9-4c11-b580-60e7a24d0e97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de15b36d-2b79-466b-a06c-a72c17091769"}], "security_groups": [{"name": "tempest-securitygroup--507876668"}], "key_name": "tempest-keypair-104121", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:05.009029 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-eec6c326-ac42-4141-b6b2-dcc1f0e34a53 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] validate_networks() for [('de15b36d-2b79-466b-a06c-a72c17091769', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:17:05.384912 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-eec6c326-ac42-4141-b6b2-dcc1f0e34a53 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:17:05.385328 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-eec6c326-ac42-4141-b6b2-dcc1f0e34a53 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:17:05.385796 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-eec6c326-ac42-4141-b6b2-dcc1f0e34a53 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:17:05.386199 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-eec6c326-ac42-4141-b6b2-dcc1f0e34a53 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:17:05.386603 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-eec6c326-ac42-4141-b6b2-dcc1f0e34a53 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:17:05.395229 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eec6c326-ac42-4141-b6b2-dcc1f0e34a53 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:05.395752 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eec6c326-ac42-4141-b6b2-dcc1f0e34a53 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:05.396561 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eec6c326-ac42-4141-b6b2-dcc1f0e34a53 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:05.396992 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eec6c326-ac42-4141-b6b2-dcc1f0e34a53 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:05.414353 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-eec6c326-ac42-4141-b6b2-dcc1f0e34a53 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Getting quotas for project 9312b8e64f51472da613ba9a553d6c08. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:17:05.418281 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-eec6c326-ac42-4141-b6b2-dcc1f0e34a53 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Getting quotas for user 32e4266183744daea8c01bd9f3b503e1 and project 9312b8e64f51472da613ba9a553d6c08. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:17:05.429780 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-eec6c326-ac42-4141-b6b2-dcc1f0e34a53 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:17:05.432232 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-eec6c326-ac42-4141-b6b2-dcc1f0e34a53 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4385a199-a3e9-4c11-b580-60e7a24d0e97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:17:05.480339 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-eec6c326-ac42-4141-b6b2-dcc1f0e34a53 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.571448 Oct 28 12:17:05.481009 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 330/683] 10.222.0.37 () {60 vars in 1146 bytes} [Thu Oct 28 12:17:04 2021] POST /compute/v2.1/servers => generated 401 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:17:05.492165 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-62eeab87-bd00-4974-97df-7e6977742965 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:05.493078 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-62eeab87-bd00-4974-97df-7e6977742965 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:05.554544 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-62eeab87-bd00-4974-97df-7e6977742965 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:05.561265 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-62eeab87-bd00-4974-97df-7e6977742965 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1234 microversion: 2.1 time: 0.073087 Oct 28 12:17:05.562870 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 354/684] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:05 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1234 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:05.584451 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ac100d5d-2c1c-4de0-bd23-da4bddcca4cd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:05.586528 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ac100d5d-2c1c-4de0-bd23-da4bddcca4cd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:05.599474 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ac100d5d-2c1c-4de0-bd23-da4bddcca4cd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:05.600026 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ac100d5d-2c1c-4de0-bd23-da4bddcca4cd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:05.604018 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ac100d5d-2c1c-4de0-bd23-da4bddcca4cd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:05.604684 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ac100d5d-2c1c-4de0-bd23-da4bddcca4cd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:05.648643 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ac100d5d-2c1c-4de0-bd23-da4bddcca4cd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:17:05.748791 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ac100d5d-2c1c-4de0-bd23-da4bddcca4cd tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "DELETE /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 204 len: 0 microversion: 2.1 time: 0.180942 Oct 28 12:17:05.750185 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 331/685] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:17:05 2021] DELETE /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:17:05.761318 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9a493c98-758b-4a0e-946a-e4103856bf52 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:05.762036 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9a493c98-758b-4a0e-946a-e4103856bf52 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:05.776456 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9a493c98-758b-4a0e-946a-e4103856bf52 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:05.777936 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9a493c98-758b-4a0e-946a-e4103856bf52 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:05.779085 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9a493c98-758b-4a0e-946a-e4103856bf52 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:05.780846 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9a493c98-758b-4a0e-946a-e4103856bf52 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:05.853600 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b8688d9a-f136-4f01-92d9-a70fa3c152db tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:05.854860 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b8688d9a-f136-4f01-92d9-a70fa3c152db tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:05.892825 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b8688d9a-f136-4f01-92d9-a70fa3c152db tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:05.893278 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b8688d9a-f136-4f01-92d9-a70fa3c152db tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:05.894071 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b8688d9a-f136-4f01-92d9-a70fa3c152db tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:05.894487 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b8688d9a-f136-4f01-92d9-a70fa3c152db tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:05.984450 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9a493c98-758b-4a0e-946a-e4103856bf52 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:05.995500 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9a493c98-758b-4a0e-946a-e4103856bf52 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1515 microversion: 2.1 time: 0.240482 Oct 28 12:17:05.996141 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 355/686] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:05 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1515 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:06.022027 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b8688d9a-f136-4f01-92d9-a70fa3c152db tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 30283 microversion: 2.20 time: 0.172672 Oct 28 12:17:06.022775 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 332/687] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:17:05 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 30283 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:17:06.582080 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0cfcc8ea-faf0-4246-8538-fcecaf65beb1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:06.582719 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0cfcc8ea-faf0-4246-8538-fcecaf65beb1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:06.589816 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0cfcc8ea-faf0-4246-8538-fcecaf65beb1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:06.589943 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0cfcc8ea-faf0-4246-8538-fcecaf65beb1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:06.591845 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0cfcc8ea-faf0-4246-8538-fcecaf65beb1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:06.592587 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0cfcc8ea-faf0-4246-8538-fcecaf65beb1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:06.665921 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0cfcc8ea-faf0-4246-8538-fcecaf65beb1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:06.674895 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0cfcc8ea-faf0-4246-8538-fcecaf65beb1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1286 microversion: 2.1 time: 0.097332 Oct 28 12:17:06.675469 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 356/688] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:06 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:07.016381 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ad3b2df5-a3e6-4dad-9780-09ff02744049 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:07.017091 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ad3b2df5-a3e6-4dad-9780-09ff02744049 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:07.023967 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad3b2df5-a3e6-4dad-9780-09ff02744049 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:07.024516 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad3b2df5-a3e6-4dad-9780-09ff02744049 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:07.025167 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad3b2df5-a3e6-4dad-9780-09ff02744049 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:07.025595 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad3b2df5-a3e6-4dad-9780-09ff02744049 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:07.033460 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bc5683df-3459-4b58-8b0c-15a2d3ece6e5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:07.034348 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bc5683df-3459-4b58-8b0c-15a2d3ece6e5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:07.040120 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc5683df-3459-4b58-8b0c-15a2d3ece6e5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:07.040780 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc5683df-3459-4b58-8b0c-15a2d3ece6e5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:07.041563 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc5683df-3459-4b58-8b0c-15a2d3ece6e5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:07.041993 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc5683df-3459-4b58-8b0c-15a2d3ece6e5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:07.142977 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bc5683df-3459-4b58-8b0c-15a2d3ece6e5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 31806 microversion: 2.20 time: 0.113081 Oct 28 12:17:07.148143 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 357/689] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:17:07 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 31806 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:17:07.157818 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ad3b2df5-a3e6-4dad-9780-09ff02744049 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:07.168461 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ad3b2df5-a3e6-4dad-9780-09ff02744049 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1515 microversion: 2.1 time: 0.156590 Oct 28 12:17:07.170077 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 333/690] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:07 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:07.692456 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ec079fa9-b846-48a5-8644-bfb87db15123 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:07.693149 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ec079fa9-b846-48a5-8644-bfb87db15123 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:07.700037 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ec079fa9-b846-48a5-8644-bfb87db15123 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:07.700486 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ec079fa9-b846-48a5-8644-bfb87db15123 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:07.701280 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ec079fa9-b846-48a5-8644-bfb87db15123 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:07.701718 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ec079fa9-b846-48a5-8644-bfb87db15123 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:07.902115 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ec079fa9-b846-48a5-8644-bfb87db15123 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:07.910009 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ec079fa9-b846-48a5-8644-bfb87db15123 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1359 microversion: 2.1 time: 0.221589 Oct 28 12:17:07.910693 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 358/691] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:07 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:17:08.159050 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3d963370-df46-423c-a138-6aa1b6064322 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:08.161037 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3d963370-df46-423c-a138-6aa1b6064322 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:08.168148 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d963370-df46-423c-a138-6aa1b6064322 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:08.168597 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d963370-df46-423c-a138-6aa1b6064322 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:08.169376 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d963370-df46-423c-a138-6aa1b6064322 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:08.169799 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d963370-df46-423c-a138-6aa1b6064322 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:08.185843 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-aeaae207-0cbf-47c8-8fd4-b58b40560638 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:08.186496 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-aeaae207-0cbf-47c8-8fd4-b58b40560638 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:08.196476 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aeaae207-0cbf-47c8-8fd4-b58b40560638 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:08.196922 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aeaae207-0cbf-47c8-8fd4-b58b40560638 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:08.197702 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aeaae207-0cbf-47c8-8fd4-b58b40560638 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:08.198132 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aeaae207-0cbf-47c8-8fd4-b58b40560638 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:08.391635 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-aeaae207-0cbf-47c8-8fd4-b58b40560638 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:08.403045 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-aeaae207-0cbf-47c8-8fd4-b58b40560638 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1515 microversion: 2.1 time: 0.221337 Oct 28 12:17:08.403661 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 359/692] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:08 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1515 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:17:08.410061 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-8d6313a2-d7a4-4174-80c5-f4d24ed1e960 req-b3470e7f-08da-4505-b160-b31a389c45f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3cfb902-8c2c-4a98-b226-147d495a83e9", "tag": "162964eb-ccde-495d-a9be-489d9176ff3b"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:08.411481 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:17:08.411481 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:17:08.426636 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-8d6313a2-d7a4-4174-80c5-f4d24ed1e960 req-b3470e7f-08da-4505-b160-b31a389c45f1 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:08.427197 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-8d6313a2-d7a4-4174-80c5-f4d24ed1e960 req-b3470e7f-08da-4505-b160-b31a389c45f1 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:08.439198 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-8d6313a2-d7a4-4174-80c5-f4d24ed1e960 req-b3470e7f-08da-4505-b160-b31a389c45f1 service nova] Creating event network-changed:162964eb-ccde-495d-a9be-489d9176ff3b for instance e3cfb902-8c2c-4a98-b226-147d495a83e9 on hv-cinder-81571 Oct 28 12:17:08.444073 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-8d6313a2-d7a4-4174-80c5-f4d24ed1e960 req-b3470e7f-08da-4505-b160-b31a389c45f1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037398 Oct 28 12:17:08.444758 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 360/693] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:17:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:17:08.599929 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3d963370-df46-423c-a138-6aa1b6064322 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 33362 microversion: 2.20 time: 0.447961 Oct 28 12:17:08.600961 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 334/694] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:17:08 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 33362 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:17:08.928201 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9c8e7e1e-891e-4665-87c4-bd89180c4a46 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:08.928892 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9c8e7e1e-891e-4665-87c4-bd89180c4a46 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:08.935448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9c8e7e1e-891e-4665-87c4-bd89180c4a46 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:08.935892 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9c8e7e1e-891e-4665-87c4-bd89180c4a46 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:08.936662 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9c8e7e1e-891e-4665-87c4-bd89180c4a46 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:08.937121 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9c8e7e1e-891e-4665-87c4-bd89180c4a46 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:09.343905 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9c8e7e1e-891e-4665-87c4-bd89180c4a46 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:09.353274 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9c8e7e1e-891e-4665-87c4-bd89180c4a46 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1359 microversion: 2.1 time: 0.429435 Oct 28 12:17:09.353858 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 361/695] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:08 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1359 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:09.421156 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4c4feeb1-a475-4e80-827c-c8dd536ee130 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:09.421853 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4c4feeb1-a475-4e80-827c-c8dd536ee130 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:09.429583 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4c4feeb1-a475-4e80-827c-c8dd536ee130 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:09.430030 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4c4feeb1-a475-4e80-827c-c8dd536ee130 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:09.430837 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4c4feeb1-a475-4e80-827c-c8dd536ee130 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:09.431275 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4c4feeb1-a475-4e80-827c-c8dd536ee130 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:09.612462 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c96fd40c-f5f3-4b3a-b865-7a9ffd3b9e30 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:09.613364 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c96fd40c-f5f3-4b3a-b865-7a9ffd3b9e30 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:09.619970 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c96fd40c-f5f3-4b3a-b865-7a9ffd3b9e30 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:09.620505 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c96fd40c-f5f3-4b3a-b865-7a9ffd3b9e30 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:09.621350 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c96fd40c-f5f3-4b3a-b865-7a9ffd3b9e30 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:09.621785 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c96fd40c-f5f3-4b3a-b865-7a9ffd3b9e30 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:09.638104 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4c4feeb1-a475-4e80-827c-c8dd536ee130 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f6b74ea1274a9bba153118ccf63571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f032353009b64d738b6c00574846cb51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:09.646075 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4c4feeb1-a475-4e80-827c-c8dd536ee130 tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 200 len: 1515 microversion: 2.1 time: 0.229707 Oct 28 12:17:09.646870 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 335/696] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:09 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 1515 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:09.786862 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c96fd40c-f5f3-4b3a-b865-7a9ffd3b9e30 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 34474 microversion: 2.20 time: 0.178240 Oct 28 12:17:09.787544 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 362/697] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:17:09 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 34474 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:17:09.824870 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-6371f7f1-9c4b-41c2-9568-b3a7048deae0 req-579fb14f-e904-4117-acf3-e24e05ac5318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8e6f3a-3f05-49d7-b1d4-b714a4382010", "name": "network-vif-deleted", "tag": "9150fd45-c84d-4736-a6a2-8247b4b15dda"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:09.826972 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:17:09.826972 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:17:09.834329 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-6371f7f1-9c4b-41c2-9568-b3a7048deae0 req-579fb14f-e904-4117-acf3-e24e05ac5318 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:09.834792 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-6371f7f1-9c4b-41c2-9568-b3a7048deae0 req-579fb14f-e904-4117-acf3-e24e05ac5318 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:09.847883 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-6371f7f1-9c4b-41c2-9568-b3a7048deae0 req-579fb14f-e904-4117-acf3-e24e05ac5318 service nova] Creating event network-vif-deleted:9150fd45-c84d-4736-a6a2-8247b4b15dda for instance 0e8e6f3a-3f05-49d7-b1d4-b714a4382010 on hv-cinder-81571 Oct 28 12:17:09.853270 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-6371f7f1-9c4b-41c2-9568-b3a7048deae0 req-579fb14f-e904-4117-acf3-e24e05ac5318 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032059 Oct 28 12:17:09.853929 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 336/698] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:17:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:17:10.371127 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0243877f-04ae-4731-a58c-2007d18806d7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:10.372097 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0243877f-04ae-4731-a58c-2007d18806d7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:10.380093 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0243877f-04ae-4731-a58c-2007d18806d7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:10.380739 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0243877f-04ae-4731-a58c-2007d18806d7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:10.381903 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0243877f-04ae-4731-a58c-2007d18806d7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:10.382437 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0243877f-04ae-4731-a58c-2007d18806d7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:10.510362 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0243877f-04ae-4731-a58c-2007d18806d7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:10.518614 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0243877f-04ae-4731-a58c-2007d18806d7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1359 microversion: 2.1 time: 0.151767 Oct 28 12:17:10.519211 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 363/699] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:10 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:10.664616 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5e6b1766-f88c-48c1-ab09-6a5c1e8bc52f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:10.665278 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5e6b1766-f88c-48c1-ab09-6a5c1e8bc52f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] [instance: 0e8e6f3a-3f05-49d7-b1d4-b714a4382010] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:10.672049 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5e6b1766-f88c-48c1-ab09-6a5c1e8bc52f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:10.672492 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5e6b1766-f88c-48c1-ab09-6a5c1e8bc52f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:10.673254 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5e6b1766-f88c-48c1-ab09-6a5c1e8bc52f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:10.673684 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5e6b1766-f88c-48c1-ab09-6a5c1e8bc52f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:10.688840 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-5e6b1766-f88c-48c1-ab09-6a5c1e8bc52f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] HTTP exception thrown: Instance 0e8e6f3a-3f05-49d7-b1d4-b714a4382010 could not be found. Oct 28 12:17:10.689409 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5e6b1766-f88c-48c1-ab09-6a5c1e8bc52f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] Returning 404 to user: Instance 0e8e6f3a-3f05-49d7-b1d4-b714a4382010 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:17:10.690219 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5e6b1766-f88c-48c1-ab09-6a5c1e8bc52f tempest-AttachVolumeNegativeTest-409795608 tempest-AttachVolumeNegativeTest-409795608-project] 10.222.0.37 "GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010" status: 404 len: 111 microversion: 2.1 time: 0.030161 Oct 28 12:17:10.690741 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 337/700] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:10 2021] GET /compute/v2.1/servers/0e8e6f3a-3f05-49d7-b1d4-b714a4382010 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:17:10.799589 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ead4fccc-bf3c-42c3-afd2-5ecd8e8d2aa6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:10.800490 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ead4fccc-bf3c-42c3-afd2-5ecd8e8d2aa6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:10.806550 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ead4fccc-bf3c-42c3-afd2-5ecd8e8d2aa6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:10.807021 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ead4fccc-bf3c-42c3-afd2-5ecd8e8d2aa6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:10.807780 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ead4fccc-bf3c-42c3-afd2-5ecd8e8d2aa6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:10.808207 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ead4fccc-bf3c-42c3-afd2-5ecd8e8d2aa6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:11.086964 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ead4fccc-bf3c-42c3-afd2-5ecd8e8d2aa6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 35308 microversion: 2.20 time: 0.291115 Oct 28 12:17:11.087609 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 364/701] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:17:10 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 35308 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:17:11.535325 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f3ec0209-6921-4a80-9a4f-ba7ca899d8dc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:11.535944 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f3ec0209-6921-4a80-9a4f-ba7ca899d8dc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:11.541946 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3ec0209-6921-4a80-9a4f-ba7ca899d8dc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:11.542381 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3ec0209-6921-4a80-9a4f-ba7ca899d8dc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:11.543339 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3ec0209-6921-4a80-9a4f-ba7ca899d8dc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:11.543759 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3ec0209-6921-4a80-9a4f-ba7ca899d8dc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:11.667587 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f3ec0209-6921-4a80-9a4f-ba7ca899d8dc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:11.675272 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f3ec0209-6921-4a80-9a4f-ba7ca899d8dc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1359 microversion: 2.1 time: 0.143397 Oct 28 12:17:11.675769 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 338/702] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:11 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:12.099787 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-03afe340-ea0d-4c48-96a6-eddfe44bfe34 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:12.100873 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-03afe340-ea0d-4c48-96a6-eddfe44bfe34 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:12.108136 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-03afe340-ea0d-4c48-96a6-eddfe44bfe34 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:12.108578 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-03afe340-ea0d-4c48-96a6-eddfe44bfe34 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:12.109343 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-03afe340-ea0d-4c48-96a6-eddfe44bfe34 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:12.109777 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-03afe340-ea0d-4c48-96a6-eddfe44bfe34 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:12.226735 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-03afe340-ea0d-4c48-96a6-eddfe44bfe34 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 36039 microversion: 2.20 time: 0.129929 Oct 28 12:17:12.230968 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 365/703] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:17:12 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 36039 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:17:12.691744 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4fdb9e6f-236a-4f0b-9a74-d51de0aa43fe tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:12.692392 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4fdb9e6f-236a-4f0b-9a74-d51de0aa43fe tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:12.698826 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fdb9e6f-236a-4f0b-9a74-d51de0aa43fe tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:12.699262 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fdb9e6f-236a-4f0b-9a74-d51de0aa43fe tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:12.700026 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fdb9e6f-236a-4f0b-9a74-d51de0aa43fe tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:12.700446 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fdb9e6f-236a-4f0b-9a74-d51de0aa43fe tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:12.822386 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4fdb9e6f-236a-4f0b-9a74-d51de0aa43fe tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:12.830260 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4fdb9e6f-236a-4f0b-9a74-d51de0aa43fe tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1359 microversion: 2.1 time: 0.142164 Oct 28 12:17:12.830944 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 339/704] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:12 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1359 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:13.239307 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1e505cc8-008c-4750-8362-9a9864c4e58b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:13.240194 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1e505cc8-008c-4750-8362-9a9864c4e58b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:13.247034 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1e505cc8-008c-4750-8362-9a9864c4e58b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:13.247977 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1e505cc8-008c-4750-8362-9a9864c4e58b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:13.248743 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1e505cc8-008c-4750-8362-9a9864c4e58b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:13.249176 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1e505cc8-008c-4750-8362-9a9864c4e58b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:13.341701 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1e505cc8-008c-4750-8362-9a9864c4e58b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 36899 microversion: 2.20 time: 0.106444 Oct 28 12:17:13.342345 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 366/705] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:17:13 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 36899 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:17:13.847051 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9427e907-36a8-4f61-a125-5b0bd5ee5a46 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:13.847571 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9427e907-36a8-4f61-a125-5b0bd5ee5a46 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:13.853709 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9427e907-36a8-4f61-a125-5b0bd5ee5a46 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:13.854152 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9427e907-36a8-4f61-a125-5b0bd5ee5a46 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:13.854944 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9427e907-36a8-4f61-a125-5b0bd5ee5a46 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:13.855381 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9427e907-36a8-4f61-a125-5b0bd5ee5a46 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:13.977303 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9427e907-36a8-4f61-a125-5b0bd5ee5a46 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:13.985060 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9427e907-36a8-4f61-a125-5b0bd5ee5a46 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1359 microversion: 2.1 time: 0.141764 Oct 28 12:17:13.985623 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 340/706] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:13 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1359 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:14.353710 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0b308726-8ab8-4d31-b4ec-e81e35e21eb3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:14.354634 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0b308726-8ab8-4d31-b4ec-e81e35e21eb3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:14.365072 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0b308726-8ab8-4d31-b4ec-e81e35e21eb3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:14.365072 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0b308726-8ab8-4d31-b4ec-e81e35e21eb3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:14.365072 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0b308726-8ab8-4d31-b4ec-e81e35e21eb3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:14.365375 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0b308726-8ab8-4d31-b4ec-e81e35e21eb3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:14.514579 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0b308726-8ab8-4d31-b4ec-e81e35e21eb3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 38103 microversion: 2.20 time: 0.164726 Oct 28 12:17:14.515294 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 367/707] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:17:14 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 38103 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:17:15.004079 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-41ba6183-3634-44a0-b4ea-773f3d347e4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:15.004867 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-41ba6183-3634-44a0-b4ea-773f3d347e4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:15.013532 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-41ba6183-3634-44a0-b4ea-773f3d347e4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:15.014339 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-41ba6183-3634-44a0-b4ea-773f3d347e4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:15.015618 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-41ba6183-3634-44a0-b4ea-773f3d347e4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:15.016058 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-41ba6183-3634-44a0-b4ea-773f3d347e4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:15.136633 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-41ba6183-3634-44a0-b4ea-773f3d347e4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:15.143810 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-41ba6183-3634-44a0-b4ea-773f3d347e4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1359 microversion: 2.1 time: 0.145646 Oct 28 12:17:15.144370 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 341/708] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:14 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:15.525697 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-76324a83-be5b-41b0-af89-fdf1a8501455 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:15.526708 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-76324a83-be5b-41b0-af89-fdf1a8501455 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:15.533385 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-76324a83-be5b-41b0-af89-fdf1a8501455 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:15.533834 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-76324a83-be5b-41b0-af89-fdf1a8501455 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:15.534602 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-76324a83-be5b-41b0-af89-fdf1a8501455 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:15.535064 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-76324a83-be5b-41b0-af89-fdf1a8501455 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:15.620426 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-76324a83-be5b-41b0-af89-fdf1a8501455 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 38158 microversion: 2.20 time: 0.098612 Oct 28 12:17:15.621436 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 368/709] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:17:15 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 38158 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:17:16.160228 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bc4541ce-0d58-446d-b44f-bf9fbfd71caf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:16.160829 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bc4541ce-0d58-446d-b44f-bf9fbfd71caf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:16.167799 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc4541ce-0d58-446d-b44f-bf9fbfd71caf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:16.168314 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc4541ce-0d58-446d-b44f-bf9fbfd71caf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:16.169563 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc4541ce-0d58-446d-b44f-bf9fbfd71caf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:16.169986 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc4541ce-0d58-446d-b44f-bf9fbfd71caf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:16.299521 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-bc4541ce-0d58-446d-b44f-bf9fbfd71caf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:16.307607 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bc4541ce-0d58-446d-b44f-bf9fbfd71caf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1359 microversion: 2.1 time: 0.151005 Oct 28 12:17:16.308378 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 342/710] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:16 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:16.635631 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-196ce08a-a6b1-442f-82d4-ed4e4134df3e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:16.636678 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-196ce08a-a6b1-442f-82d4-ed4e4134df3e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:16.646371 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-196ce08a-a6b1-442f-82d4-ed4e4134df3e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:16.647033 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-196ce08a-a6b1-442f-82d4-ed4e4134df3e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:16.648008 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-196ce08a-a6b1-442f-82d4-ed4e4134df3e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:16.648597 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-196ce08a-a6b1-442f-82d4-ed4e4134df3e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:16.737275 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-196ce08a-a6b1-442f-82d4-ed4e4134df3e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 38158 microversion: 2.20 time: 0.105758 Oct 28 12:17:16.741629 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 369/711] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:17:16 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 38158 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:17:17.326112 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3d7e4933-66e0-4c96-9c3a-51fa743ba709 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:17.326830 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3d7e4933-66e0-4c96-9c3a-51fa743ba709 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:17.333297 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d7e4933-66e0-4c96-9c3a-51fa743ba709 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:17.333738 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d7e4933-66e0-4c96-9c3a-51fa743ba709 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:17.334514 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d7e4933-66e0-4c96-9c3a-51fa743ba709 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:17.334970 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3d7e4933-66e0-4c96-9c3a-51fa743ba709 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:17.467138 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3d7e4933-66e0-4c96-9c3a-51fa743ba709 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:17.475340 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3d7e4933-66e0-4c96-9c3a-51fa743ba709 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1359 microversion: 2.1 time: 0.153849 Oct 28 12:17:17.475949 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 343/712] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:17 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:17.501425 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5dcd5dcd-59e4-4940-a1ec-141db18a1ad8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce67e6d4-51e5-4b36-9808-7e363ea6b8ae", "device": "/dev/sdb"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:17.503074 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5dcd5dcd-59e4-4940-a1ec-141db18a1ad8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:17.509842 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5dcd5dcd-59e4-4940-a1ec-141db18a1ad8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:17.510286 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5dcd5dcd-59e4-4940-a1ec-141db18a1ad8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:17.511080 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5dcd5dcd-59e4-4940-a1ec-141db18a1ad8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:17.511515 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5dcd5dcd-59e4-4940-a1ec-141db18a1ad8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:17.752950 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d9c2e572-8fc5-423f-b4a0-457d33bcd5ba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:17.754058 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d9c2e572-8fc5-423f-b4a0-457d33bcd5ba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:17.760441 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9c2e572-8fc5-423f-b4a0-457d33bcd5ba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:17.761735 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9c2e572-8fc5-423f-b4a0-457d33bcd5ba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:17.762530 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9c2e572-8fc5-423f-b4a0-457d33bcd5ba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:17.763225 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9c2e572-8fc5-423f-b4a0-457d33bcd5ba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:17.808059 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5dcd5dcd-59e4-4940-a1ec-141db18a1ad8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "POST /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305443 Oct 28 12:17:17.808059 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 370/713] 10.222.0.37 () {60 vars in 1322 bytes} [Thu Oct 28 12:17:17 2021] POST /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:17:17.891291 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d9c2e572-8fc5-423f-b4a0-457d33bcd5ba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 38158 microversion: 2.20 time: 0.145925 Oct 28 12:17:17.892752 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 344/714] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:17:17 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 38158 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:17:18.388649 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-3027eb07-4a73-42e1-ac6f-d5b4da0b3e41 req-cd3dd737-0192-40ad-9c4a-80c71c668e69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3cfb902-8c2c-4a98-b226-147d495a83e9", "name": "network-vif-plugged", "status": "completed", "tag": "162964eb-ccde-495d-a9be-489d9176ff3b"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:18.390163 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:17:18.390163 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:17:18.397723 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-3027eb07-4a73-42e1-ac6f-d5b4da0b3e41 req-cd3dd737-0192-40ad-9c4a-80c71c668e69 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:18.398234 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-3027eb07-4a73-42e1-ac6f-d5b4da0b3e41 req-cd3dd737-0192-40ad-9c4a-80c71c668e69 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:18.410655 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-3027eb07-4a73-42e1-ac6f-d5b4da0b3e41 req-cd3dd737-0192-40ad-9c4a-80c71c668e69 service nova] Creating event network-vif-plugged:162964eb-ccde-495d-a9be-489d9176ff3b for instance e3cfb902-8c2c-4a98-b226-147d495a83e9 on hv-cinder-81571 Oct 28 12:17:18.415753 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-3027eb07-4a73-42e1-ac6f-d5b4da0b3e41 req-cd3dd737-0192-40ad-9c4a-80c71c668e69 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030623 Oct 28 12:17:18.416359 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 371/715] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:17:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:17:18.492728 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a20d9e23-42c9-4ac3-95c7-a446754cf1bc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:18.493223 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a20d9e23-42c9-4ac3-95c7-a446754cf1bc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:18.500823 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a20d9e23-42c9-4ac3-95c7-a446754cf1bc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:18.501261 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a20d9e23-42c9-4ac3-95c7-a446754cf1bc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:18.502058 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a20d9e23-42c9-4ac3-95c7-a446754cf1bc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:18.502663 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a20d9e23-42c9-4ac3-95c7-a446754cf1bc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:18.744995 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a20d9e23-42c9-4ac3-95c7-a446754cf1bc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:18.752399 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a20d9e23-42c9-4ac3-95c7-a446754cf1bc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1359 microversion: 2.1 time: 0.264043 Oct 28 12:17:18.752885 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 345/716] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:18 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1359 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:17:18.905312 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-129475b5-3f74-44fc-9b17-b0cfdf5ffc44 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:18.906439 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-129475b5-3f74-44fc-9b17-b0cfdf5ffc44 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:18.916362 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-129475b5-3f74-44fc-9b17-b0cfdf5ffc44 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:18.916910 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-129475b5-3f74-44fc-9b17-b0cfdf5ffc44 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:18.918143 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-129475b5-3f74-44fc-9b17-b0cfdf5ffc44 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:18.918854 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-129475b5-3f74-44fc-9b17-b0cfdf5ffc44 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:19.102475 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-129475b5-3f74-44fc-9b17-b0cfdf5ffc44 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 38158 microversion: 2.20 time: 0.202491 Oct 28 12:17:19.110991 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 372/717] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:17:18 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 38158 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:17:19.769177 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6e589422-2913-43c2-b78a-00c97ba07d3b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:19.769893 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6e589422-2913-43c2-b78a-00c97ba07d3b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:19.776118 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6e589422-2913-43c2-b78a-00c97ba07d3b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:19.776564 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6e589422-2913-43c2-b78a-00c97ba07d3b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:19.777336 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6e589422-2913-43c2-b78a-00c97ba07d3b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:19.777770 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6e589422-2913-43c2-b78a-00c97ba07d3b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:19.910575 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6e589422-2913-43c2-b78a-00c97ba07d3b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:19.918301 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6e589422-2913-43c2-b78a-00c97ba07d3b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1359 microversion: 2.1 time: 0.153274 Oct 28 12:17:19.928426 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 346/718] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:19 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:20.119525 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8855ba2a-8e42-4d23-a471-9641cba8ca59 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:20.120449 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8855ba2a-8e42-4d23-a471-9641cba8ca59 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:20.127397 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8855ba2a-8e42-4d23-a471-9641cba8ca59 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:20.127831 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8855ba2a-8e42-4d23-a471-9641cba8ca59 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:20.128631 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8855ba2a-8e42-4d23-a471-9641cba8ca59 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:20.129077 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8855ba2a-8e42-4d23-a471-9641cba8ca59 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:20.222941 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8855ba2a-8e42-4d23-a471-9641cba8ca59 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 200 len: 38301 microversion: 2.20 time: 0.107465 Oct 28 12:17:20.223708 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 373/719] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:17:20 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 38301 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:17:20.233685 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2fce57e0-7bcf-4b87-91e1-9ca3fe0ffc98 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:20.234178 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2fce57e0-7bcf-4b87-91e1-9ca3fe0ffc98 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:20.240465 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2fce57e0-7bcf-4b87-91e1-9ca3fe0ffc98 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:20.240787 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2fce57e0-7bcf-4b87-91e1-9ca3fe0ffc98 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:20.241560 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2fce57e0-7bcf-4b87-91e1-9ca3fe0ffc98 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:20.241992 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2fce57e0-7bcf-4b87-91e1-9ca3fe0ffc98 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:20.272913 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2fce57e0-7bcf-4b87-91e1-9ca3fe0ffc98 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/ips" status: 200 len: 150 microversion: 2.20 time: 0.042989 Oct 28 12:17:20.273784 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 347/720] 10.222.0.37 () {60 vars in 1288 bytes} [Thu Oct 28 12:17:20 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:17:20.936759 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c2c1bd46-21f2-428d-89a5-63e6c93ccc2d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:20.937678 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c2c1bd46-21f2-428d-89a5-63e6c93ccc2d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:20.944547 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c2c1bd46-21f2-428d-89a5-63e6c93ccc2d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:20.944993 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c2c1bd46-21f2-428d-89a5-63e6c93ccc2d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:20.945979 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c2c1bd46-21f2-428d-89a5-63e6c93ccc2d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:20.946430 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c2c1bd46-21f2-428d-89a5-63e6c93ccc2d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:21.089303 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c2c1bd46-21f2-428d-89a5-63e6c93ccc2d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:21.097063 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c2c1bd46-21f2-428d-89a5-63e6c93ccc2d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1545 microversion: 2.1 time: 0.164899 Oct 28 12:17:21.097835 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 374/721] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:20 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1545 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:21.116480 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c817c9bf-9af3-42a6-afb6-ed9d58a51e00 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:21.116954 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c817c9bf-9af3-42a6-afb6-ed9d58a51e00 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:21.123485 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c817c9bf-9af3-42a6-afb6-ed9d58a51e00 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:21.123921 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c817c9bf-9af3-42a6-afb6-ed9d58a51e00 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:21.125057 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c817c9bf-9af3-42a6-afb6-ed9d58a51e00 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:21.125614 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c817c9bf-9af3-42a6-afb6-ed9d58a51e00 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:21.212179 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c817c9bf-9af3-42a6-afb6-ed9d58a51e00 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100165 Oct 28 12:17:21.212797 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 348/722] 10.222.0.37 () {58 vars in 1274 bytes} [Thu Oct 28 12:17:21 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:17:22.236276 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b643896c-c7e9-4825-bcfc-7c820822d232 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:22.237187 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b643896c-c7e9-4825-bcfc-7c820822d232 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:22.239215 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-c78ba9be-827e-4c60-99ab-a8c4dfae8e69 req-2ac950de-68a6-4dc8-b5fd-48e2652abbba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3cfb902-8c2c-4a98-b226-147d495a83e9", "tag": "162964eb-ccde-495d-a9be-489d9176ff3b"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:22.240694 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:17:22.240694 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:17:22.246769 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b643896c-c7e9-4825-bcfc-7c820822d232 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:22.248538 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-c78ba9be-827e-4c60-99ab-a8c4dfae8e69 req-2ac950de-68a6-4dc8-b5fd-48e2652abbba service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:22.248762 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b643896c-c7e9-4825-bcfc-7c820822d232 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:22.248968 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-c78ba9be-827e-4c60-99ab-a8c4dfae8e69 req-2ac950de-68a6-4dc8-b5fd-48e2652abbba service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:22.249703 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b643896c-c7e9-4825-bcfc-7c820822d232 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:22.250199 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b643896c-c7e9-4825-bcfc-7c820822d232 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:22.263895 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-c78ba9be-827e-4c60-99ab-a8c4dfae8e69 req-2ac950de-68a6-4dc8-b5fd-48e2652abbba service nova] Creating event network-changed:162964eb-ccde-495d-a9be-489d9176ff3b for instance e3cfb902-8c2c-4a98-b226-147d495a83e9 on hv-cinder-81571 Oct 28 12:17:22.270806 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-c78ba9be-827e-4c60-99ab-a8c4dfae8e69 req-2ac950de-68a6-4dc8-b5fd-48e2652abbba service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035339 Oct 28 12:17:22.272227 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 349/723] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:17:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:17:22.341425 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b643896c-c7e9-4825-bcfc-7c820822d232 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 14 microversion: 2.1 time: 0.108431 Oct 28 12:17:22.345179 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 375/724] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:22 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:17:22.736970 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6725e255-224d-439e-9eab-b55469c421a5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:22.737546 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6725e255-224d-439e-9eab-b55469c421a5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:22.748668 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6725e255-224d-439e-9eab-b55469c421a5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:22.749180 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6725e255-224d-439e-9eab-b55469c421a5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:22.749956 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6725e255-224d-439e-9eab-b55469c421a5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:22.750380 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6725e255-224d-439e-9eab-b55469c421a5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:22.806071 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-6725e255-224d-439e-9eab-b55469c421a5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lazy-loading 'flavor' on Instance uuid d79ab524-bc96-45ce-91df-6713d6fcaaaf {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:17:23.235690 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6725e255-224d-439e-9eab-b55469c421a5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 202 len: 0 microversion: 2.20 time: 0.507240 Oct 28 12:17:23.236320 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 350/725] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:17:22 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:17:23.245576 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ca44a53e-5bd0-42b2-9c02-e699613d22b9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:23.248021 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ca44a53e-5bd0-42b2-9c02-e699613d22b9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:23.258174 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca44a53e-5bd0-42b2-9c02-e699613d22b9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:23.258967 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca44a53e-5bd0-42b2-9c02-e699613d22b9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:23.260189 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca44a53e-5bd0-42b2-9c02-e699613d22b9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:23.260834 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca44a53e-5bd0-42b2-9c02-e699613d22b9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:23.353926 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-760bda19-f873-40e1-b358-de721bfc0bc1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:23.355150 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-760bda19-f873-40e1-b358-de721bfc0bc1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:23.361261 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-760bda19-f873-40e1-b358-de721bfc0bc1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:23.361700 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-760bda19-f873-40e1-b358-de721bfc0bc1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:23.362706 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-760bda19-f873-40e1-b358-de721bfc0bc1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:23.363135 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-760bda19-f873-40e1-b358-de721bfc0bc1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:23.400386 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ca44a53e-5bd0-42b2-9c02-e699613d22b9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:23.408986 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ca44a53e-5bd0-42b2-9c02-e699613d22b9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:23.410464 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ca44a53e-5bd0-42b2-9c02-e699613d22b9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:23.411644 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ca44a53e-5bd0-42b2-9c02-e699613d22b9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.170829 Oct 28 12:17:23.412201 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 376/726] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:23 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:17:23.438024 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-760bda19-f873-40e1-b358-de721bfc0bc1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 14 microversion: 2.1 time: 0.088417 Oct 28 12:17:23.441245 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 351/727] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:23 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 12:17:24.430945 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-02bdf8d6-c2ab-44b6-9014-aa22fe484606 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:24.431748 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-02bdf8d6-c2ab-44b6-9014-aa22fe484606 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:24.444967 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-02bdf8d6-c2ab-44b6-9014-aa22fe484606 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:24.445427 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-02bdf8d6-c2ab-44b6-9014-aa22fe484606 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:24.446220 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-02bdf8d6-c2ab-44b6-9014-aa22fe484606 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:24.446652 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-02bdf8d6-c2ab-44b6-9014-aa22fe484606 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:24.450717 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-500c77f8-6add-483d-8d96-fd577cfb1c24 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:24.453778 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-500c77f8-6add-483d-8d96-fd577cfb1c24 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:24.462527 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-500c77f8-6add-483d-8d96-fd577cfb1c24 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:24.463713 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-500c77f8-6add-483d-8d96-fd577cfb1c24 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:24.464725 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-500c77f8-6add-483d-8d96-fd577cfb1c24 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:24.465311 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-500c77f8-6add-483d-8d96-fd577cfb1c24 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:24.574020 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-500c77f8-6add-483d-8d96-fd577cfb1c24 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 14 microversion: 2.1 time: 0.128288 Oct 28 12:17:24.575967 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 352/728] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:24 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 12:17:24.632033 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-02bdf8d6-c2ab-44b6-9014-aa22fe484606 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:24.640688 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-02bdf8d6-c2ab-44b6-9014-aa22fe484606 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:24.642159 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-02bdf8d6-c2ab-44b6-9014-aa22fe484606 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:24.643321 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-02bdf8d6-c2ab-44b6-9014-aa22fe484606 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.216432 Oct 28 12:17:24.644060 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 377/729] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:24 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:17:25.585931 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-047bfaca-3af2-4b7d-8573-15d296f88989 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:25.587105 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-047bfaca-3af2-4b7d-8573-15d296f88989 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:25.595043 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-047bfaca-3af2-4b7d-8573-15d296f88989 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:25.595549 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-047bfaca-3af2-4b7d-8573-15d296f88989 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:25.597055 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-047bfaca-3af2-4b7d-8573-15d296f88989 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:25.597306 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-047bfaca-3af2-4b7d-8573-15d296f88989 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:25.664133 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d942a88e-b216-4534-a48d-54d10317ccba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:25.664723 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d942a88e-b216-4534-a48d-54d10317ccba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:25.672299 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d942a88e-b216-4534-a48d-54d10317ccba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:25.673118 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d942a88e-b216-4534-a48d-54d10317ccba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:25.674173 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d942a88e-b216-4534-a48d-54d10317ccba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:25.674871 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d942a88e-b216-4534-a48d-54d10317ccba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:25.677488 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-047bfaca-3af2-4b7d-8573-15d296f88989 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 14 microversion: 2.1 time: 0.095363 Oct 28 12:17:25.681139 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 353/730] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:25 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:17:25.815842 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d942a88e-b216-4534-a48d-54d10317ccba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:25.824058 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d942a88e-b216-4534-a48d-54d10317ccba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:25.826450 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d942a88e-b216-4534-a48d-54d10317ccba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:25.828620 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d942a88e-b216-4534-a48d-54d10317ccba tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.167843 Oct 28 12:17:25.830771 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 378/731] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:25 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:17:26.688817 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dd0d8012-bdc4-42cd-934e-0c4017ee32d3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:26.689808 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dd0d8012-bdc4-42cd-934e-0c4017ee32d3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:26.696695 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dd0d8012-bdc4-42cd-934e-0c4017ee32d3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:26.697141 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dd0d8012-bdc4-42cd-934e-0c4017ee32d3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:26.697911 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dd0d8012-bdc4-42cd-934e-0c4017ee32d3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:26.698341 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dd0d8012-bdc4-42cd-934e-0c4017ee32d3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:26.848637 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5b18659c-eab8-4eca-850f-f91b95c39748 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:26.849279 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5b18659c-eab8-4eca-850f-f91b95c39748 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:26.855480 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5b18659c-eab8-4eca-850f-f91b95c39748 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:26.856422 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5b18659c-eab8-4eca-850f-f91b95c39748 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:26.857164 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5b18659c-eab8-4eca-850f-f91b95c39748 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:26.857592 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5b18659c-eab8-4eca-850f-f91b95c39748 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:26.978999 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5b18659c-eab8-4eca-850f-f91b95c39748 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:26.987092 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5b18659c-eab8-4eca-850f-f91b95c39748 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:26.988663 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5b18659c-eab8-4eca-850f-f91b95c39748 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:26.989811 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5b18659c-eab8-4eca-850f-f91b95c39748 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.145000 Oct 28 12:17:26.990372 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 379/732] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:26 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:17:28.008301 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d5370c0a-02ee-4516-aed7-48386a604a78 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:28.008907 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d5370c0a-02ee-4516-aed7-48386a604a78 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:28.015081 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d5370c0a-02ee-4516-aed7-48386a604a78 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:28.015528 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d5370c0a-02ee-4516-aed7-48386a604a78 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:28.016581 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d5370c0a-02ee-4516-aed7-48386a604a78 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:28.017112 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d5370c0a-02ee-4516-aed7-48386a604a78 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:28.136402 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d5370c0a-02ee-4516-aed7-48386a604a78 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:28.144559 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d5370c0a-02ee-4516-aed7-48386a604a78 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:28.146033 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d5370c0a-02ee-4516-aed7-48386a604a78 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:28.147217 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d5370c0a-02ee-4516-aed7-48386a604a78 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.142573 Oct 28 12:17:28.147770 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 380/733] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:28 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:17:29.164704 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-443d4275-83ea-4315-8a07-a99cac75e387 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:29.165347 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-443d4275-83ea-4315-8a07-a99cac75e387 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:29.171961 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-443d4275-83ea-4315-8a07-a99cac75e387 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:29.172435 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-443d4275-83ea-4315-8a07-a99cac75e387 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:29.173229 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-443d4275-83ea-4315-8a07-a99cac75e387 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:29.173661 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-443d4275-83ea-4315-8a07-a99cac75e387 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:29.442648 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-443d4275-83ea-4315-8a07-a99cac75e387 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:29.450438 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-443d4275-83ea-4315-8a07-a99cac75e387 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:29.451967 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-443d4275-83ea-4315-8a07-a99cac75e387 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:29.453110 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-443d4275-83ea-4315-8a07-a99cac75e387 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.292121 Oct 28 12:17:29.453664 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 381/734] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:29 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:17:30.038303 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dd0d8012-bdc4-42cd-934e-0c4017ee32d3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 14 microversion: 2.1 time: 3.353970 Oct 28 12:17:30.038969 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 354/735] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:26 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 14 bytes in 3356 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:17:30.471972 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-01d4ff24-e6fc-4af6-b268-bc316931c0d0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:30.472572 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-01d4ff24-e6fc-4af6-b268-bc316931c0d0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:30.478926 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01d4ff24-e6fc-4af6-b268-bc316931c0d0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:30.479484 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01d4ff24-e6fc-4af6-b268-bc316931c0d0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:30.480542 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01d4ff24-e6fc-4af6-b268-bc316931c0d0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:30.481032 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-01d4ff24-e6fc-4af6-b268-bc316931c0d0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:30.607804 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-01d4ff24-e6fc-4af6-b268-bc316931c0d0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:30.615867 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-01d4ff24-e6fc-4af6-b268-bc316931c0d0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:30.617364 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-01d4ff24-e6fc-4af6-b268-bc316931c0d0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:30.618551 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-01d4ff24-e6fc-4af6-b268-bc316931c0d0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.150279 Oct 28 12:17:30.619139 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 382/736] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:30 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:17:31.049623 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7894f32a-6934-42a8-9986-ac1b6e9e05f2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:31.050524 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7894f32a-6934-42a8-9986-ac1b6e9e05f2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:31.057921 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7894f32a-6934-42a8-9986-ac1b6e9e05f2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:31.058354 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7894f32a-6934-42a8-9986-ac1b6e9e05f2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:31.059140 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7894f32a-6934-42a8-9986-ac1b6e9e05f2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:31.059565 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7894f32a-6934-42a8-9986-ac1b6e9e05f2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:31.118982 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7894f32a-6934-42a8-9986-ac1b6e9e05f2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 14 microversion: 2.1 time: 0.073888 Oct 28 12:17:31.119593 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 355/737] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:31 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:17:31.636218 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f11403ba-e779-45b6-a903-172a41468dfe tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:31.636819 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f11403ba-e779-45b6-a903-172a41468dfe tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:31.643786 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f11403ba-e779-45b6-a903-172a41468dfe tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:31.644230 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f11403ba-e779-45b6-a903-172a41468dfe tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:31.644992 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f11403ba-e779-45b6-a903-172a41468dfe tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:31.645421 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f11403ba-e779-45b6-a903-172a41468dfe tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:31.762068 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f11403ba-e779-45b6-a903-172a41468dfe tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:31.770216 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f11403ba-e779-45b6-a903-172a41468dfe tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:31.771713 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f11403ba-e779-45b6-a903-172a41468dfe tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:31.772864 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f11403ba-e779-45b6-a903-172a41468dfe tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.140287 Oct 28 12:17:31.773400 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 383/738] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:31 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:17:31.893802 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3e8ccb16-1dd8-4b3a-b8d4-630faa75a5ce tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1550983734", "imageRef": "4385a199-a3e9-4c11-b580-60e7a24d0e97", "flavorRef": "452"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:32.057089 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-3e8ccb16-1dd8-4b3a-b8d4-630faa75a5ce tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] validate_networks() for None {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:17:32.129645 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bd36dbe4-abf7-4e52-8adc-47235b6ba90e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:32.130604 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bd36dbe4-abf7-4e52-8adc-47235b6ba90e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:32.136927 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bd36dbe4-abf7-4e52-8adc-47235b6ba90e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:32.137371 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bd36dbe4-abf7-4e52-8adc-47235b6ba90e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:32.138353 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bd36dbe4-abf7-4e52-8adc-47235b6ba90e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:32.139418 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bd36dbe4-abf7-4e52-8adc-47235b6ba90e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:32.350193 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-3e8ccb16-1dd8-4b3a-b8d4-630faa75a5ce tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:17:32.350657 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-3e8ccb16-1dd8-4b3a-b8d4-630faa75a5ce tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:17:32.351182 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-3e8ccb16-1dd8-4b3a-b8d4-630faa75a5ce tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:17:32.351584 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-3e8ccb16-1dd8-4b3a-b8d4-630faa75a5ce tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:17:32.351986 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-3e8ccb16-1dd8-4b3a-b8d4-630faa75a5ce tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:17:32.361031 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3e8ccb16-1dd8-4b3a-b8d4-630faa75a5ce tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:32.361464 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3e8ccb16-1dd8-4b3a-b8d4-630faa75a5ce tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:32.362260 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3e8ccb16-1dd8-4b3a-b8d4-630faa75a5ce tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:32.362707 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3e8ccb16-1dd8-4b3a-b8d4-630faa75a5ce tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:32.378950 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-3e8ccb16-1dd8-4b3a-b8d4-630faa75a5ce tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Getting quotas for project af50051562634a79a6c3c9df62bee279. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:17:32.382707 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-3e8ccb16-1dd8-4b3a-b8d4-630faa75a5ce tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Getting quotas for user c358852fa98945578fea3220025bb7ab and project af50051562634a79a6c3c9df62bee279. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:17:32.393064 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3e8ccb16-1dd8-4b3a-b8d4-630faa75a5ce tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:17:32.395562 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3e8ccb16-1dd8-4b3a-b8d4-630faa75a5ce tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4385a199-a3e9-4c11-b580-60e7a24d0e97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:17:32.439894 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3e8ccb16-1dd8-4b3a-b8d4-630faa75a5ce tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550137 Oct 28 12:17:32.440632 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 356/739] 10.222.0.37 () {60 vars in 1146 bytes} [Thu Oct 28 12:17:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:17:32.449785 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-51575f87-73a3-41fd-bd9c-666aae55061e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:32.450376 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-51575f87-73a3-41fd-bd9c-666aae55061e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:32.502034 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-51575f87-73a3-41fd-bd9c-666aae55061e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:32.509225 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-51575f87-73a3-41fd-bd9c-666aae55061e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1215 microversion: 2.1 time: 0.062791 Oct 28 12:17:32.509770 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 357/740] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:32 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1215 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:17:32.791191 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fd10e60a-84ee-4c02-a162-303c5dee1b32 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:32.791791 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fd10e60a-84ee-4c02-a162-303c5dee1b32 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:32.799120 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd10e60a-84ee-4c02-a162-303c5dee1b32 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:32.799569 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd10e60a-84ee-4c02-a162-303c5dee1b32 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:32.800416 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd10e60a-84ee-4c02-a162-303c5dee1b32 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:32.800944 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd10e60a-84ee-4c02-a162-303c5dee1b32 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:32.934910 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fd10e60a-84ee-4c02-a162-303c5dee1b32 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:32.944361 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fd10e60a-84ee-4c02-a162-303c5dee1b32 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:32.945774 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fd10e60a-84ee-4c02-a162-303c5dee1b32 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:32.946981 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fd10e60a-84ee-4c02-a162-303c5dee1b32 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.160716 Oct 28 12:17:32.947664 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 358/741] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:32 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:17:33.526725 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8406162c-267f-438c-ab79-864048928b31 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:33.527358 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8406162c-267f-438c-ab79-864048928b31 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:33.533834 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8406162c-267f-438c-ab79-864048928b31 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:33.534278 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8406162c-267f-438c-ab79-864048928b31 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:33.535084 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8406162c-267f-438c-ab79-864048928b31 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:33.535514 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8406162c-267f-438c-ab79-864048928b31 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:33.597307 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8406162c-267f-438c-ab79-864048928b31 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:33.604756 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8406162c-267f-438c-ab79-864048928b31 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1219 microversion: 2.1 time: 0.081591 Oct 28 12:17:33.605256 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 359/742] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:33 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:17:33.965426 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-350369fa-a0c3-441f-9556-bd922b981de9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:33.966051 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-350369fa-a0c3-441f-9556-bd922b981de9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:33.972344 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-350369fa-a0c3-441f-9556-bd922b981de9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:33.972790 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-350369fa-a0c3-441f-9556-bd922b981de9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:33.973555 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-350369fa-a0c3-441f-9556-bd922b981de9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:33.973984 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-350369fa-a0c3-441f-9556-bd922b981de9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:34.091380 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-350369fa-a0c3-441f-9556-bd922b981de9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:34.098896 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-350369fa-a0c3-441f-9556-bd922b981de9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:34.100360 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-350369fa-a0c3-441f-9556-bd922b981de9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:34.101483 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-350369fa-a0c3-441f-9556-bd922b981de9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.139751 Oct 28 12:17:34.102037 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 360/743] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:33 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:17:34.621735 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4a85d09b-ffdc-4563-a2db-a2e838bfcbe7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:34.622343 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4a85d09b-ffdc-4563-a2db-a2e838bfcbe7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:34.628377 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4a85d09b-ffdc-4563-a2db-a2e838bfcbe7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:34.628820 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4a85d09b-ffdc-4563-a2db-a2e838bfcbe7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:34.629586 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4a85d09b-ffdc-4563-a2db-a2e838bfcbe7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:34.630013 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4a85d09b-ffdc-4563-a2db-a2e838bfcbe7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:34.688178 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4a85d09b-ffdc-4563-a2db-a2e838bfcbe7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:34.695236 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4a85d09b-ffdc-4563-a2db-a2e838bfcbe7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1219 microversion: 2.1 time: 0.077097 Oct 28 12:17:34.695798 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 361/744] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:34 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:17:35.120379 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-52bed41c-06cd-403e-8897-e60f39684cfc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:35.120904 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-52bed41c-06cd-403e-8897-e60f39684cfc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:35.127685 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-52bed41c-06cd-403e-8897-e60f39684cfc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:35.128129 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-52bed41c-06cd-403e-8897-e60f39684cfc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:35.128886 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-52bed41c-06cd-403e-8897-e60f39684cfc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:35.129315 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-52bed41c-06cd-403e-8897-e60f39684cfc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:35.245089 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-52bed41c-06cd-403e-8897-e60f39684cfc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:35.253162 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-52bed41c-06cd-403e-8897-e60f39684cfc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:35.254646 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-52bed41c-06cd-403e-8897-e60f39684cfc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:35.255817 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-52bed41c-06cd-403e-8897-e60f39684cfc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.139530 Oct 28 12:17:35.256381 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 362/745] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:35 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:17:35.712097 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-511ba591-01d6-46bb-a403-859059d7ed59 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:35.712702 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-511ba591-01d6-46bb-a403-859059d7ed59 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:35.719308 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-511ba591-01d6-46bb-a403-859059d7ed59 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:35.719754 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-511ba591-01d6-46bb-a403-859059d7ed59 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:35.720526 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-511ba591-01d6-46bb-a403-859059d7ed59 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:35.720992 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-511ba591-01d6-46bb-a403-859059d7ed59 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:35.783210 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-511ba591-01d6-46bb-a403-859059d7ed59 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:35.790477 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-511ba591-01d6-46bb-a403-859059d7ed59 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1219 microversion: 2.1 time: 0.082153 Oct 28 12:17:35.791069 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 363/746] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:35 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:17:35.827290 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bd36dbe4-abf7-4e52-8adc-47235b6ba90e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 18498 microversion: 2.1 time: 3.701283 Oct 28 12:17:35.828306 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 384/747] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:32 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 18498 bytes in 3703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:17:36.274469 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b07c5747-2ba6-43b4-82ee-91f105b427c5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:36.275152 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b07c5747-2ba6-43b4-82ee-91f105b427c5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:36.281204 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b07c5747-2ba6-43b4-82ee-91f105b427c5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:36.281636 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b07c5747-2ba6-43b4-82ee-91f105b427c5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:36.282388 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b07c5747-2ba6-43b4-82ee-91f105b427c5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:36.282903 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b07c5747-2ba6-43b4-82ee-91f105b427c5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:36.421072 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b07c5747-2ba6-43b4-82ee-91f105b427c5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:36.428686 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b07c5747-2ba6-43b4-82ee-91f105b427c5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:36.430161 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b07c5747-2ba6-43b4-82ee-91f105b427c5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:36.431332 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b07c5747-2ba6-43b4-82ee-91f105b427c5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.160693 Oct 28 12:17:36.431884 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 364/748] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:36 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:17:36.810129 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b5655d8c-5c79-432c-be19-c9175e1547e2 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:36.810887 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b5655d8c-5c79-432c-be19-c9175e1547e2 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:36.818424 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b5655d8c-5c79-432c-be19-c9175e1547e2 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:36.818912 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b5655d8c-5c79-432c-be19-c9175e1547e2 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:36.819681 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b5655d8c-5c79-432c-be19-c9175e1547e2 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:36.820112 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b5655d8c-5c79-432c-be19-c9175e1547e2 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:36.841046 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a224ddd5-d624-4b8b-9c7d-8a0f7096f6ce tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:36.843304 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a224ddd5-d624-4b8b-9c7d-8a0f7096f6ce tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:36.850569 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a224ddd5-d624-4b8b-9c7d-8a0f7096f6ce tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:36.851195 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a224ddd5-d624-4b8b-9c7d-8a0f7096f6ce tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:36.852290 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a224ddd5-d624-4b8b-9c7d-8a0f7096f6ce tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:36.852734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a224ddd5-d624-4b8b-9c7d-8a0f7096f6ce tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:36.900183 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b5655d8c-5c79-432c-be19-c9175e1547e2 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:36.908733 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b5655d8c-5c79-432c-be19-c9175e1547e2 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1273 microversion: 2.1 time: 0.103407 Oct 28 12:17:36.912747 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 385/749] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:36 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:36.996585 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a224ddd5-d624-4b8b-9c7d-8a0f7096f6ce tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 19342 microversion: 2.1 time: 0.161479 Oct 28 12:17:36.998416 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 365/750] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:36 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 19342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:17:37.450212 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-92d16ce8-4e72-4897-83ce-6bfec20b02c7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:37.451496 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-92d16ce8-4e72-4897-83ce-6bfec20b02c7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:37.459696 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-92d16ce8-4e72-4897-83ce-6bfec20b02c7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:37.460096 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-92d16ce8-4e72-4897-83ce-6bfec20b02c7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:37.461394 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-92d16ce8-4e72-4897-83ce-6bfec20b02c7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:37.462074 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-92d16ce8-4e72-4897-83ce-6bfec20b02c7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:37.602339 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-92d16ce8-4e72-4897-83ce-6bfec20b02c7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:37.610008 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-92d16ce8-4e72-4897-83ce-6bfec20b02c7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:37.611655 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-92d16ce8-4e72-4897-83ce-6bfec20b02c7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:37.612811 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-92d16ce8-4e72-4897-83ce-6bfec20b02c7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.166502 Oct 28 12:17:37.613367 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 386/751] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:37 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:17:37.925884 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-75358d83-f78d-4158-8ba5-733a92836324 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:37.926573 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-75358d83-f78d-4158-8ba5-733a92836324 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:37.933348 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-75358d83-f78d-4158-8ba5-733a92836324 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:37.933789 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-75358d83-f78d-4158-8ba5-733a92836324 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:37.934541 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-75358d83-f78d-4158-8ba5-733a92836324 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:37.934999 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-75358d83-f78d-4158-8ba5-733a92836324 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:38.008839 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-750c589f-289b-406c-947a-f2d430d94d99 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:38.009740 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-750c589f-289b-406c-947a-f2d430d94d99 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:38.016506 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-750c589f-289b-406c-947a-f2d430d94d99 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:38.016948 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-750c589f-289b-406c-947a-f2d430d94d99 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:38.017720 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-750c589f-289b-406c-947a-f2d430d94d99 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:38.018144 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-750c589f-289b-406c-947a-f2d430d94d99 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:38.064581 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-75358d83-f78d-4158-8ba5-733a92836324 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:38.071711 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-75358d83-f78d-4158-8ba5-733a92836324 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1315 microversion: 2.1 time: 0.149883 Oct 28 12:17:38.072265 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 366/752] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:37 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:38.632200 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0b6c26c2-f268-485a-b863-769ee88f2b87 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:38.632773 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0b6c26c2-f268-485a-b863-769ee88f2b87 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:38.639414 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0b6c26c2-f268-485a-b863-769ee88f2b87 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:38.639847 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0b6c26c2-f268-485a-b863-769ee88f2b87 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:38.640594 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0b6c26c2-f268-485a-b863-769ee88f2b87 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:38.641017 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0b6c26c2-f268-485a-b863-769ee88f2b87 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:38.760564 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0b6c26c2-f268-485a-b863-769ee88f2b87 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:38.769146 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0b6c26c2-f268-485a-b863-769ee88f2b87 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:38.770556 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0b6c26c2-f268-485a-b863-769ee88f2b87 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:38.771716 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0b6c26c2-f268-485a-b863-769ee88f2b87 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.143708 Oct 28 12:17:38.772265 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 367/753] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:38 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:17:39.088852 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-095fa360-f7e4-4601-a26d-d2d80f1a97ab tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:39.089480 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-095fa360-f7e4-4601-a26d-d2d80f1a97ab tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:39.095558 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-095fa360-f7e4-4601-a26d-d2d80f1a97ab tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:39.096037 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-095fa360-f7e4-4601-a26d-d2d80f1a97ab tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:39.096831 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-095fa360-f7e4-4601-a26d-d2d80f1a97ab tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:39.097262 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-095fa360-f7e4-4601-a26d-d2d80f1a97ab tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:39.219280 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-095fa360-f7e4-4601-a26d-d2d80f1a97ab tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:39.226426 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-095fa360-f7e4-4601-a26d-d2d80f1a97ab tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1315 microversion: 2.1 time: 0.141311 Oct 28 12:17:39.227028 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 368/754] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:39 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:17:39.888681 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ff3eff87-32d6-4294-96ff-5b0c1077ed08 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:39.889287 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ff3eff87-32d6-4294-96ff-5b0c1077ed08 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:39.895143 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ff3eff87-32d6-4294-96ff-5b0c1077ed08 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:39.895592 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ff3eff87-32d6-4294-96ff-5b0c1077ed08 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:39.896351 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ff3eff87-32d6-4294-96ff-5b0c1077ed08 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:39.896788 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ff3eff87-32d6-4294-96ff-5b0c1077ed08 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:40.018326 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ff3eff87-32d6-4294-96ff-5b0c1077ed08 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:40.025947 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ff3eff87-32d6-4294-96ff-5b0c1077ed08 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:40.027578 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ff3eff87-32d6-4294-96ff-5b0c1077ed08 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:40.028711 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ff3eff87-32d6-4294-96ff-5b0c1077ed08 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.241855 Oct 28 12:17:40.029821 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 369/755] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:39 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:17:40.242590 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d8faa3ea-106e-437b-859e-ddd6e15feefe tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:40.243224 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d8faa3ea-106e-437b-859e-ddd6e15feefe tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:40.249245 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d8faa3ea-106e-437b-859e-ddd6e15feefe tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:40.249679 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d8faa3ea-106e-437b-859e-ddd6e15feefe tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:40.250437 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d8faa3ea-106e-437b-859e-ddd6e15feefe tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:40.250966 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d8faa3ea-106e-437b-859e-ddd6e15feefe tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:40.369382 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d8faa3ea-106e-437b-859e-ddd6e15feefe tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:40.376474 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d8faa3ea-106e-437b-859e-ddd6e15feefe tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1315 microversion: 2.1 time: 0.137483 Oct 28 12:17:40.377030 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 370/756] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:40 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1315 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:17:41.047647 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9662527b-e971-42b3-b4e1-98ec645e7282 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:41.048239 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9662527b-e971-42b3-b4e1-98ec645e7282 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:41.054415 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9662527b-e971-42b3-b4e1-98ec645e7282 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:41.054894 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9662527b-e971-42b3-b4e1-98ec645e7282 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:41.055645 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9662527b-e971-42b3-b4e1-98ec645e7282 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:41.056064 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9662527b-e971-42b3-b4e1-98ec645e7282 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:41.176287 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9662527b-e971-42b3-b4e1-98ec645e7282 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:41.183762 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9662527b-e971-42b3-b4e1-98ec645e7282 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:41.185834 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9662527b-e971-42b3-b4e1-98ec645e7282 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:41.186998 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9662527b-e971-42b3-b4e1-98ec645e7282 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.143776 Oct 28 12:17:41.187548 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 371/757] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:41 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:17:41.392873 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-58c8e61e-96c5-49c0-8361-1145c4436d4e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:41.393493 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-58c8e61e-96c5-49c0-8361-1145c4436d4e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:41.399134 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58c8e61e-96c5-49c0-8361-1145c4436d4e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:41.399570 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58c8e61e-96c5-49c0-8361-1145c4436d4e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:41.400318 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58c8e61e-96c5-49c0-8361-1145c4436d4e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:41.400738 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58c8e61e-96c5-49c0-8361-1145c4436d4e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:41.518429 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-58c8e61e-96c5-49c0-8361-1145c4436d4e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:41.525555 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-58c8e61e-96c5-49c0-8361-1145c4436d4e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1315 microversion: 2.1 time: 0.136339 Oct 28 12:17:41.526252 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 372/758] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:41 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1315 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:41.724218 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-750c589f-289b-406c-947a-f2d430d94d99 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 26768 microversion: 2.1 time: 3.717191 Oct 28 12:17:41.728920 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 387/759] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:38 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 26768 bytes in 3725 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:17:42.205781 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-715f24d5-e74f-4b57-a419-f6d8df460c66 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:42.206384 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-715f24d5-e74f-4b57-a419-f6d8df460c66 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:42.212659 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-715f24d5-e74f-4b57-a419-f6d8df460c66 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:42.213100 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-715f24d5-e74f-4b57-a419-f6d8df460c66 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:42.213892 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-715f24d5-e74f-4b57-a419-f6d8df460c66 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:42.214318 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-715f24d5-e74f-4b57-a419-f6d8df460c66 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:42.321940 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-d367fcd5-a55a-4f1d-8d78-681fe482a870 req-0eef6101-f954-49bf-ac71-2f74cbf6b315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94e10a41-d291-42ca-a7e6-2fb621dc259e", "tag": "a8d48b1b-1297-449d-869b-dde209a1c611"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:42.323501 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:17:42.323501 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:17:42.332056 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-d367fcd5-a55a-4f1d-8d78-681fe482a870 req-0eef6101-f954-49bf-ac71-2f74cbf6b315 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:42.332968 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-d367fcd5-a55a-4f1d-8d78-681fe482a870 req-0eef6101-f954-49bf-ac71-2f74cbf6b315 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:42.353645 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-d367fcd5-a55a-4f1d-8d78-681fe482a870 req-0eef6101-f954-49bf-ac71-2f74cbf6b315 service nova] Creating event network-changed:a8d48b1b-1297-449d-869b-dde209a1c611 for instance 94e10a41-d291-42ca-a7e6-2fb621dc259e on hv-cinder-81571 Oct 28 12:17:42.359289 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-d367fcd5-a55a-4f1d-8d78-681fe482a870 req-0eef6101-f954-49bf-ac71-2f74cbf6b315 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041616 Oct 28 12:17:42.362816 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 388/760] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:17:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:17:42.399667 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-715f24d5-e74f-4b57-a419-f6d8df460c66 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:42.408356 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-715f24d5-e74f-4b57-a419-f6d8df460c66 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:42.410004 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-715f24d5-e74f-4b57-a419-f6d8df460c66 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:42.411179 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-715f24d5-e74f-4b57-a419-f6d8df460c66 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.209237 Oct 28 12:17:42.411743 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 373/761] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:42 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:17:42.547035 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-843c8549-bd37-45a1-9ed3-0416d8ef3d42 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:42.547728 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-843c8549-bd37-45a1-9ed3-0416d8ef3d42 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:42.553638 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-843c8549-bd37-45a1-9ed3-0416d8ef3d42 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:42.554074 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-843c8549-bd37-45a1-9ed3-0416d8ef3d42 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:42.555050 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-843c8549-bd37-45a1-9ed3-0416d8ef3d42 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:42.555479 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-843c8549-bd37-45a1-9ed3-0416d8ef3d42 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:42.689934 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-843c8549-bd37-45a1-9ed3-0416d8ef3d42 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:42.697339 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-843c8549-bd37-45a1-9ed3-0416d8ef3d42 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1315 microversion: 2.1 time: 0.156339 Oct 28 12:17:42.697900 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 389/762] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:42 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:42.736927 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-93e920d5-5af7-4c04-9a58-6c3c39b1d1a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:42.737949 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-93e920d5-5af7-4c04-9a58-6c3c39b1d1a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:42.743799 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-93e920d5-5af7-4c04-9a58-6c3c39b1d1a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:42.744242 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-93e920d5-5af7-4c04-9a58-6c3c39b1d1a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:42.744999 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-93e920d5-5af7-4c04-9a58-6c3c39b1d1a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:42.745432 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-93e920d5-5af7-4c04-9a58-6c3c39b1d1a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:42.852254 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-93e920d5-5af7-4c04-9a58-6c3c39b1d1a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 27488 microversion: 2.1 time: 0.119027 Oct 28 12:17:42.852925 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 374/763] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:42 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 27488 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:17:43.429436 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5425ff42-a352-4e1f-9420-1a09bf49c5e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:43.430153 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5425ff42-a352-4e1f-9420-1a09bf49c5e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:43.436998 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5425ff42-a352-4e1f-9420-1a09bf49c5e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:43.437439 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5425ff42-a352-4e1f-9420-1a09bf49c5e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:43.438205 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5425ff42-a352-4e1f-9420-1a09bf49c5e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:43.438643 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5425ff42-a352-4e1f-9420-1a09bf49c5e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:43.563342 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5425ff42-a352-4e1f-9420-1a09bf49c5e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:43.571293 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5425ff42-a352-4e1f-9420-1a09bf49c5e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:43.572976 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5425ff42-a352-4e1f-9420-1a09bf49c5e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:43.574168 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5425ff42-a352-4e1f-9420-1a09bf49c5e4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.148459 Oct 28 12:17:43.574904 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 390/764] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:43 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:17:43.714759 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-166371b4-6f2e-47d5-9812-08e34804705d tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:43.715445 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-166371b4-6f2e-47d5-9812-08e34804705d tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:43.722212 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-166371b4-6f2e-47d5-9812-08e34804705d tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:43.722810 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-166371b4-6f2e-47d5-9812-08e34804705d tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:43.723567 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-166371b4-6f2e-47d5-9812-08e34804705d tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:43.723992 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-166371b4-6f2e-47d5-9812-08e34804705d tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:43.845867 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-166371b4-6f2e-47d5-9812-08e34804705d tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:43.853456 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-166371b4-6f2e-47d5-9812-08e34804705d tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1315 microversion: 2.1 time: 0.142809 Oct 28 12:17:43.854018 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 375/765] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:43 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:17:43.863711 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fbe73891-3f91-4b30-b698-bd4e7fbb3b5e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:43.864615 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fbe73891-3f91-4b30-b698-bd4e7fbb3b5e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:43.870882 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fbe73891-3f91-4b30-b698-bd4e7fbb3b5e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:43.871359 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fbe73891-3f91-4b30-b698-bd4e7fbb3b5e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:43.872126 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fbe73891-3f91-4b30-b698-bd4e7fbb3b5e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:43.873242 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fbe73891-3f91-4b30-b698-bd4e7fbb3b5e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:44.302068 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fbe73891-3f91-4b30-b698-bd4e7fbb3b5e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 27788 microversion: 2.1 time: 0.441751 Oct 28 12:17:44.302762 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 391/766] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:43 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 27788 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:17:44.593897 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-88d352b7-6ebc-4ea6-a1fd-a6fd5f245c7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:44.594500 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-88d352b7-6ebc-4ea6-a1fd-a6fd5f245c7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:44.600630 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-88d352b7-6ebc-4ea6-a1fd-a6fd5f245c7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:44.601076 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-88d352b7-6ebc-4ea6-a1fd-a6fd5f245c7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:44.602052 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-88d352b7-6ebc-4ea6-a1fd-a6fd5f245c7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:44.602486 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-88d352b7-6ebc-4ea6-a1fd-a6fd5f245c7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:44.725299 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-88d352b7-6ebc-4ea6-a1fd-a6fd5f245c7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:44.733989 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-88d352b7-6ebc-4ea6-a1fd-a6fd5f245c7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:44.735662 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-88d352b7-6ebc-4ea6-a1fd-a6fd5f245c7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:44.736807 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-88d352b7-6ebc-4ea6-a1fd-a6fd5f245c7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.147440 Oct 28 12:17:44.737370 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 376/767] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:44 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:17:44.870569 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a7b6687b-076a-4c56-b552-d6948be6fdd0 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:44.871281 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a7b6687b-076a-4c56-b552-d6948be6fdd0 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:44.878036 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a7b6687b-076a-4c56-b552-d6948be6fdd0 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:44.878473 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a7b6687b-076a-4c56-b552-d6948be6fdd0 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:44.879255 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a7b6687b-076a-4c56-b552-d6948be6fdd0 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:44.879676 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a7b6687b-076a-4c56-b552-d6948be6fdd0 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:44.999927 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a7b6687b-076a-4c56-b552-d6948be6fdd0 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:45.007199 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a7b6687b-076a-4c56-b552-d6948be6fdd0 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1315 microversion: 2.1 time: 0.140822 Oct 28 12:17:45.007769 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 392/768] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:44 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1315 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:45.313120 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1fac6fb7-6c88-436d-8c1a-8d17d533c830 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:45.314124 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1fac6fb7-6c88-436d-8c1a-8d17d533c830 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:45.320686 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1fac6fb7-6c88-436d-8c1a-8d17d533c830 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:45.321138 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1fac6fb7-6c88-436d-8c1a-8d17d533c830 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:45.321896 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1fac6fb7-6c88-436d-8c1a-8d17d533c830 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:45.322318 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1fac6fb7-6c88-436d-8c1a-8d17d533c830 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:45.401740 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1fac6fb7-6c88-436d-8c1a-8d17d533c830 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 27915 microversion: 2.1 time: 0.091910 Oct 28 12:17:45.402375 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 377/769] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:45 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 27915 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:17:45.756813 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-282315d5-4199-4f3d-ae50-c887ed4b3e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:45.757413 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-282315d5-4199-4f3d-ae50-c887ed4b3e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:45.763614 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-282315d5-4199-4f3d-ae50-c887ed4b3e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:45.764053 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-282315d5-4199-4f3d-ae50-c887ed4b3e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:45.764840 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-282315d5-4199-4f3d-ae50-c887ed4b3e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:45.765269 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-282315d5-4199-4f3d-ae50-c887ed4b3e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:45.895315 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-282315d5-4199-4f3d-ae50-c887ed4b3e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:45.903251 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-282315d5-4199-4f3d-ae50-c887ed4b3e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:45.905216 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-282315d5-4199-4f3d-ae50-c887ed4b3e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:45.906499 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-282315d5-4199-4f3d-ae50-c887ed4b3e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.154231 Oct 28 12:17:45.907140 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 393/770] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:45 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:17:46.027050 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b905f501-beb3-4b75-858a-c5218239b0a4 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:46.027729 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b905f501-beb3-4b75-858a-c5218239b0a4 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:46.034577 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b905f501-beb3-4b75-858a-c5218239b0a4 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:46.035048 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b905f501-beb3-4b75-858a-c5218239b0a4 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:46.035803 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b905f501-beb3-4b75-858a-c5218239b0a4 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:46.036222 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b905f501-beb3-4b75-858a-c5218239b0a4 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:46.158556 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b905f501-beb3-4b75-858a-c5218239b0a4 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:46.166102 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b905f501-beb3-4b75-858a-c5218239b0a4 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1315 microversion: 2.1 time: 0.143128 Oct 28 12:17:46.166688 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 378/771] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:46 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:17:46.413912 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6214e268-9b91-4f8c-a65a-aab631455c65 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:46.414870 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6214e268-9b91-4f8c-a65a-aab631455c65 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:46.421716 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6214e268-9b91-4f8c-a65a-aab631455c65 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:46.422150 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6214e268-9b91-4f8c-a65a-aab631455c65 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:46.422938 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6214e268-9b91-4f8c-a65a-aab631455c65 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:46.423361 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6214e268-9b91-4f8c-a65a-aab631455c65 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:46.557238 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6214e268-9b91-4f8c-a65a-aab631455c65 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 27966 microversion: 2.1 time: 0.146767 Oct 28 12:17:46.558160 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 394/772] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:46 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 27966 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:17:46.590832 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-59cfa7c9-1daf-45b7-ab51-a349f25015ff tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:46.591291 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-59cfa7c9-1daf-45b7-ab51-a349f25015ff tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:46.598354 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59cfa7c9-1daf-45b7-ab51-a349f25015ff tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:46.598841 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59cfa7c9-1daf-45b7-ab51-a349f25015ff tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:46.599618 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59cfa7c9-1daf-45b7-ab51-a349f25015ff tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:46.600051 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59cfa7c9-1daf-45b7-ab51-a349f25015ff tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:46.688822 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-59cfa7c9-1daf-45b7-ab51-a349f25015ff tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lazy-loading 'services' on Instance uuid 15ebab3a-a58c-4216-862c-564d4d365c37 {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:17:46.749164 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-59cfa7c9-1daf-45b7-ab51-a349f25015ff tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "DELETE /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37/os-volume_attachments/ce67e6d4-51e5-4b36-9808-7e363ea6b8ae" status: 202 len: 0 microversion: 2.1 time: 0.162206 Oct 28 12:17:46.749755 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 379/773] 10.222.0.37 () {58 vars in 1415 bytes} [Thu Oct 28 12:17:46 2021] DELETE /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37/os-volume_attachments/ce67e6d4-51e5-4b36-9808-7e363ea6b8ae => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:17:46.926262 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a312af22-e5f3-4bd4-9727-c59da849f6bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:46.926915 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a312af22-e5f3-4bd4-9727-c59da849f6bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:46.934096 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a312af22-e5f3-4bd4-9727-c59da849f6bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:46.934700 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a312af22-e5f3-4bd4-9727-c59da849f6bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:46.935540 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a312af22-e5f3-4bd4-9727-c59da849f6bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:46.935980 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a312af22-e5f3-4bd4-9727-c59da849f6bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:47.062060 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a312af22-e5f3-4bd4-9727-c59da849f6bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:47.070271 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a312af22-e5f3-4bd4-9727-c59da849f6bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:47.071781 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a312af22-e5f3-4bd4-9727-c59da849f6bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:47.072922 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a312af22-e5f3-4bd4-9727-c59da849f6bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.150817 Oct 28 12:17:47.073474 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 395/774] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:46 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:17:47.184323 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e5f8ca4c-10a5-4d51-97c2-9371c3d36ff7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:47.184934 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e5f8ca4c-10a5-4d51-97c2-9371c3d36ff7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:47.191205 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e5f8ca4c-10a5-4d51-97c2-9371c3d36ff7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:47.191644 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e5f8ca4c-10a5-4d51-97c2-9371c3d36ff7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:47.192408 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e5f8ca4c-10a5-4d51-97c2-9371c3d36ff7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:47.192857 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e5f8ca4c-10a5-4d51-97c2-9371c3d36ff7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:47.314871 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e5f8ca4c-10a5-4d51-97c2-9371c3d36ff7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:47.322113 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e5f8ca4c-10a5-4d51-97c2-9371c3d36ff7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1315 microversion: 2.1 time: 0.142293 Oct 28 12:17:47.322668 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 380/775] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:47 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:47.568967 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c0517759-ae4b-4cac-9cc5-86ab10ccf978 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:47.569785 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c0517759-ae4b-4cac-9cc5-86ab10ccf978 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:47.576097 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0517759-ae4b-4cac-9cc5-86ab10ccf978 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:47.576539 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0517759-ae4b-4cac-9cc5-86ab10ccf978 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:47.577860 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0517759-ae4b-4cac-9cc5-86ab10ccf978 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:47.578292 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0517759-ae4b-4cac-9cc5-86ab10ccf978 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:47.668572 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c0517759-ae4b-4cac-9cc5-86ab10ccf978 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.102932 Oct 28 12:17:47.669216 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 396/776] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:47 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:17:48.091842 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-655ca966-8a9f-4b50-9fb0-31c004657717 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:48.092434 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-655ca966-8a9f-4b50-9fb0-31c004657717 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:48.099631 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-655ca966-8a9f-4b50-9fb0-31c004657717 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:48.100066 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-655ca966-8a9f-4b50-9fb0-31c004657717 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:48.100884 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-655ca966-8a9f-4b50-9fb0-31c004657717 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:48.101523 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-655ca966-8a9f-4b50-9fb0-31c004657717 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:48.227264 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-655ca966-8a9f-4b50-9fb0-31c004657717 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:48.235548 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-655ca966-8a9f-4b50-9fb0-31c004657717 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:48.237029 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-655ca966-8a9f-4b50-9fb0-31c004657717 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:48.238166 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-655ca966-8a9f-4b50-9fb0-31c004657717 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1743 microversion: 2.20 time: 0.150540 Oct 28 12:17:48.238731 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 381/777] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:48 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:17:48.339237 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e912a7d4-5f05-445f-b773-40217c96649e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:48.339888 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e912a7d4-5f05-445f-b773-40217c96649e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:48.348554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e912a7d4-5f05-445f-b773-40217c96649e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:48.348999 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e912a7d4-5f05-445f-b773-40217c96649e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:48.349769 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e912a7d4-5f05-445f-b773-40217c96649e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:48.350201 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e912a7d4-5f05-445f-b773-40217c96649e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:48.477799 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e912a7d4-5f05-445f-b773-40217c96649e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:48.485026 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e912a7d4-5f05-445f-b773-40217c96649e tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1315 microversion: 2.1 time: 0.150013 Oct 28 12:17:48.485592 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 397/778] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:48 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:48.681375 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-97c2eb30-445e-405a-aa39-46701f48cdd2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:48.682470 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-97c2eb30-445e-405a-aa39-46701f48cdd2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:48.688736 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-97c2eb30-445e-405a-aa39-46701f48cdd2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:48.689172 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-97c2eb30-445e-405a-aa39-46701f48cdd2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:48.689927 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-97c2eb30-445e-405a-aa39-46701f48cdd2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:48.690352 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-97c2eb30-445e-405a-aa39-46701f48cdd2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:48.818064 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-97c2eb30-445e-405a-aa39-46701f48cdd2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.140168 Oct 28 12:17:48.818722 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 382/779] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:48 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:17:48.913899 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a182c79b-08dc-48aa-984b-520f27233fa1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:48.914479 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a182c79b-08dc-48aa-984b-520f27233fa1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:48.920922 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a182c79b-08dc-48aa-984b-520f27233fa1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:48.921354 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a182c79b-08dc-48aa-984b-520f27233fa1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:48.922103 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a182c79b-08dc-48aa-984b-520f27233fa1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:48.922523 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a182c79b-08dc-48aa-984b-520f27233fa1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:48.947360 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a182c79b-08dc-48aa-984b-520f27233fa1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:17:49.018576 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a182c79b-08dc-48aa-984b-520f27233fa1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "DELETE /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 204 len: 0 microversion: 2.1 time: 0.107946 Oct 28 12:17:49.019268 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 398/780] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:17:48 2021] DELETE /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:17:49.027966 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-95a7836d-385c-4840-b8ad-63f36a58a143 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:49.028694 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-95a7836d-385c-4840-b8ad-63f36a58a143 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:49.035651 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-95a7836d-385c-4840-b8ad-63f36a58a143 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:49.036095 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-95a7836d-385c-4840-b8ad-63f36a58a143 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:49.036862 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-95a7836d-385c-4840-b8ad-63f36a58a143 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:49.037294 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-95a7836d-385c-4840-b8ad-63f36a58a143 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:49.181751 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-95a7836d-385c-4840-b8ad-63f36a58a143 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:49.189803 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-95a7836d-385c-4840-b8ad-63f36a58a143 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1514 microversion: 2.1 time: 0.166136 Oct 28 12:17:49.190475 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 383/781] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:49 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:49.257254 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8f1e65b1-2983-4440-8c85-7b41a56f9189 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:49.258836 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8f1e65b1-2983-4440-8c85-7b41a56f9189 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:49.266165 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f1e65b1-2983-4440-8c85-7b41a56f9189 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:49.266761 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f1e65b1-2983-4440-8c85-7b41a56f9189 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:49.267634 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f1e65b1-2983-4440-8c85-7b41a56f9189 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:49.268304 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f1e65b1-2983-4440-8c85-7b41a56f9189 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:49.395942 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8f1e65b1-2983-4440-8c85-7b41a56f9189 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:49.403961 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8f1e65b1-2983-4440-8c85-7b41a56f9189 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:49.405591 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8f1e65b1-2983-4440-8c85-7b41a56f9189 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:49.407304 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8f1e65b1-2983-4440-8c85-7b41a56f9189 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1743 microversion: 2.20 time: 0.154434 Oct 28 12:17:49.407936 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 399/782] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:49 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:17:49.502354 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d9d02c62-7f8b-4fbe-8115-79fcd912b9d8 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:49.503060 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d9d02c62-7f8b-4fbe-8115-79fcd912b9d8 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:49.509380 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9d02c62-7f8b-4fbe-8115-79fcd912b9d8 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:49.509820 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9d02c62-7f8b-4fbe-8115-79fcd912b9d8 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:49.510574 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9d02c62-7f8b-4fbe-8115-79fcd912b9d8 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:49.511023 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9d02c62-7f8b-4fbe-8115-79fcd912b9d8 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:49.635933 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d9d02c62-7f8b-4fbe-8115-79fcd912b9d8 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:49.644716 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d9d02c62-7f8b-4fbe-8115-79fcd912b9d8 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1315 microversion: 2.1 time: 0.146620 Oct 28 12:17:49.645347 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 384/783] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:49 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:49.830937 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-049b5a24-7c26-4823-8bb3-ca063036c18b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:49.832249 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-049b5a24-7c26-4823-8bb3-ca063036c18b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:49.839670 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-049b5a24-7c26-4823-8bb3-ca063036c18b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:49.840188 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-049b5a24-7c26-4823-8bb3-ca063036c18b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:49.841023 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-049b5a24-7c26-4823-8bb3-ca063036c18b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:49.841519 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-049b5a24-7c26-4823-8bb3-ca063036c18b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:49.914588 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-049b5a24-7c26-4823-8bb3-ca063036c18b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.088259 Oct 28 12:17:49.915410 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 400/784] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:49 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:17:50.207542 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-830dee10-888d-4a9f-b236-d039d20b4a3b tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:50.208059 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-830dee10-888d-4a9f-b236-d039d20b4a3b tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:50.214314 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-830dee10-888d-4a9f-b236-d039d20b4a3b tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:50.214792 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-830dee10-888d-4a9f-b236-d039d20b4a3b tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:50.215542 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-830dee10-888d-4a9f-b236-d039d20b4a3b tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:50.215961 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-830dee10-888d-4a9f-b236-d039d20b4a3b tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:50.336136 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-830dee10-888d-4a9f-b236-d039d20b4a3b tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:50.343350 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-830dee10-888d-4a9f-b236-d039d20b4a3b tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1514 microversion: 2.1 time: 0.139472 Oct 28 12:17:50.343907 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 385/785] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:50 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1514 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:50.426157 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-807ff1e9-fd5d-4234-871f-6d743eba4d15 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:50.426948 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-807ff1e9-fd5d-4234-871f-6d743eba4d15 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:50.433796 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-807ff1e9-fd5d-4234-871f-6d743eba4d15 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:50.434244 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-807ff1e9-fd5d-4234-871f-6d743eba4d15 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:50.435046 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-807ff1e9-fd5d-4234-871f-6d743eba4d15 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:50.435475 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-807ff1e9-fd5d-4234-871f-6d743eba4d15 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:50.561493 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-807ff1e9-fd5d-4234-871f-6d743eba4d15 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:50.569864 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-807ff1e9-fd5d-4234-871f-6d743eba4d15 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:50.571383 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-807ff1e9-fd5d-4234-871f-6d743eba4d15 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:50.572530 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-807ff1e9-fd5d-4234-871f-6d743eba4d15 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1743 microversion: 2.20 time: 0.150500 Oct 28 12:17:50.573080 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 401/786] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:50 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:17:50.656963 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-fc51f2ea-dc37-4b5b-a46f-ab47dfc50544 req-f224ae7a-1e00-4f24-99f6-1299f9482f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94e10a41-d291-42ca-a7e6-2fb621dc259e", "name": "network-vif-plugged", "status": "completed", "tag": "a8d48b1b-1297-449d-869b-dde209a1c611"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:50.658695 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:17:50.658695 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:17:50.660801 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-149f2ce0-d97f-4986-9c6c-eb9308ad7ee8 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:50.661437 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-149f2ce0-d97f-4986-9c6c-eb9308ad7ee8 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:50.665507 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-fc51f2ea-dc37-4b5b-a46f-ab47dfc50544 req-f224ae7a-1e00-4f24-99f6-1299f9482f5b service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:50.666258 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-fc51f2ea-dc37-4b5b-a46f-ab47dfc50544 req-f224ae7a-1e00-4f24-99f6-1299f9482f5b service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:50.671822 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-149f2ce0-d97f-4986-9c6c-eb9308ad7ee8 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:50.672572 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-149f2ce0-d97f-4986-9c6c-eb9308ad7ee8 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:50.673053 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-149f2ce0-d97f-4986-9c6c-eb9308ad7ee8 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:50.673484 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-149f2ce0-d97f-4986-9c6c-eb9308ad7ee8 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:50.680609 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-fc51f2ea-dc37-4b5b-a46f-ab47dfc50544 req-f224ae7a-1e00-4f24-99f6-1299f9482f5b service nova] Creating event network-vif-plugged:a8d48b1b-1297-449d-869b-dde209a1c611 for instance 94e10a41-d291-42ca-a7e6-2fb621dc259e on hv-cinder-81571 Oct 28 12:17:50.686614 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-fc51f2ea-dc37-4b5b-a46f-ab47dfc50544 req-f224ae7a-1e00-4f24-99f6-1299f9482f5b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033091 Oct 28 12:17:50.688577 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 386/787] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:17:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:17:50.841576 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-149f2ce0-d97f-4986-9c6c-eb9308ad7ee8 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:50.850291 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-149f2ce0-d97f-4986-9c6c-eb9308ad7ee8 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1315 microversion: 2.1 time: 0.192914 Oct 28 12:17:50.850992 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 402/788] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:50 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:50.928248 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c5e81200-69a6-40c1-95d0-6a5b8035da85 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:50.929586 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c5e81200-69a6-40c1-95d0-6a5b8035da85 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:50.936349 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c5e81200-69a6-40c1-95d0-6a5b8035da85 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:50.937386 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c5e81200-69a6-40c1-95d0-6a5b8035da85 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:50.938350 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c5e81200-69a6-40c1-95d0-6a5b8035da85 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:50.938796 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c5e81200-69a6-40c1-95d0-6a5b8035da85 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:51.004049 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c5e81200-69a6-40c1-95d0-6a5b8035da85 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.079615 Oct 28 12:17:51.008111 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 387/789] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:50 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:17:51.361515 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-14d70320-1ce2-4747-8134-ebf8cd50fd0c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:51.363517 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-14d70320-1ce2-4747-8134-ebf8cd50fd0c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:51.370386 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-14d70320-1ce2-4747-8134-ebf8cd50fd0c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:51.370944 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-14d70320-1ce2-4747-8134-ebf8cd50fd0c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:51.371811 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-14d70320-1ce2-4747-8134-ebf8cd50fd0c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:51.372314 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-14d70320-1ce2-4747-8134-ebf8cd50fd0c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:51.578665 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-14d70320-1ce2-4747-8134-ebf8cd50fd0c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:51.587470 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-14d70320-1ce2-4747-8134-ebf8cd50fd0c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1514 microversion: 2.1 time: 0.230942 Oct 28 12:17:51.588035 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 403/790] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:51 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1514 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:51.592678 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-786bda12-dd98-405e-8064-f67879d17c91 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:51.593574 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-786bda12-dd98-405e-8064-f67879d17c91 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:51.601297 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-786bda12-dd98-405e-8064-f67879d17c91 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:51.601762 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-786bda12-dd98-405e-8064-f67879d17c91 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:51.602634 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-786bda12-dd98-405e-8064-f67879d17c91 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:51.603103 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-786bda12-dd98-405e-8064-f67879d17c91 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:51.728326 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-786bda12-dd98-405e-8064-f67879d17c91 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:51.736691 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-786bda12-dd98-405e-8064-f67879d17c91 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:51.738182 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-786bda12-dd98-405e-8064-f67879d17c91 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:51.739363 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-786bda12-dd98-405e-8064-f67879d17c91 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1743 microversion: 2.20 time: 0.152646 Oct 28 12:17:51.739926 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 388/791] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:51 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:17:51.866687 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8acfd7f2-58ce-472f-b1a3-acfadecbe844 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:51.867369 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8acfd7f2-58ce-472f-b1a3-acfadecbe844 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:51.875010 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8acfd7f2-58ce-472f-b1a3-acfadecbe844 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:51.875449 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8acfd7f2-58ce-472f-b1a3-acfadecbe844 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:51.876207 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8acfd7f2-58ce-472f-b1a3-acfadecbe844 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:51.876627 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8acfd7f2-58ce-472f-b1a3-acfadecbe844 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:52.016612 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ce010bdb-3470-41f3-84ca-77c068a89cf7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:52.017724 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ce010bdb-3470-41f3-84ca-77c068a89cf7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:52.023790 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce010bdb-3470-41f3-84ca-77c068a89cf7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:52.024552 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce010bdb-3470-41f3-84ca-77c068a89cf7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:52.026255 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce010bdb-3470-41f3-84ca-77c068a89cf7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:52.026874 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8acfd7f2-58ce-472f-b1a3-acfadecbe844 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:52.027202 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce010bdb-3470-41f3-84ca-77c068a89cf7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:52.037688 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8acfd7f2-58ce-472f-b1a3-acfadecbe844 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1315 microversion: 2.1 time: 0.174375 Oct 28 12:17:52.038796 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 404/792] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:51 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:52.152043 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ce010bdb-3470-41f3-84ca-77c068a89cf7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.139426 Oct 28 12:17:52.152736 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 389/793] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:52 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:17:52.486560 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-117a8990-2fe0-4509-a759-9f6ae4a42ed8 req-5d9caec5-04f2-47c2-8d77-4e0102f1aa35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ebab3a-a58c-4216-862c-564d4d365c37", "name": "network-vif-deleted", "tag": "1619934b-8d83-409a-9b55-2549b46519eb"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:52.493198 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:17:52.493198 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:17:52.504041 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-117a8990-2fe0-4509-a759-9f6ae4a42ed8 req-5d9caec5-04f2-47c2-8d77-4e0102f1aa35 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:52.504682 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-117a8990-2fe0-4509-a759-9f6ae4a42ed8 req-5d9caec5-04f2-47c2-8d77-4e0102f1aa35 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:52.519625 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-117a8990-2fe0-4509-a759-9f6ae4a42ed8 req-5d9caec5-04f2-47c2-8d77-4e0102f1aa35 service nova] Creating event network-vif-deleted:1619934b-8d83-409a-9b55-2549b46519eb for instance 15ebab3a-a58c-4216-862c-564d4d365c37 on hv-cinder-81571 Oct 28 12:17:52.540461 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-117a8990-2fe0-4509-a759-9f6ae4a42ed8 req-5d9caec5-04f2-47c2-8d77-4e0102f1aa35 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043263 Oct 28 12:17:52.541304 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 405/794] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:17:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:17:52.614820 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3bf42e1f-b439-4149-8706-6ba6e76bbb2b tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:52.615674 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3bf42e1f-b439-4149-8706-6ba6e76bbb2b tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:52.627002 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3bf42e1f-b439-4149-8706-6ba6e76bbb2b tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:52.627449 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3bf42e1f-b439-4149-8706-6ba6e76bbb2b tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:52.628232 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3bf42e1f-b439-4149-8706-6ba6e76bbb2b tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:52.628660 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3bf42e1f-b439-4149-8706-6ba6e76bbb2b tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:52.677624 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3bf42e1f-b439-4149-8706-6ba6e76bbb2b tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:52.678057 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3bf42e1f-b439-4149-8706-6ba6e76bbb2b tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:52.678497 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-3bf42e1f-b439-4149-8706-6ba6e76bbb2b tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lazy-loading 'fault' on Instance uuid 15ebab3a-a58c-4216-862c-564d4d365c37 {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:17:52.704912 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-ad493297-08af-412e-b19a-6bcc7c092b45 req-d9b099cf-1d63-400a-bf6d-d71dcc50801a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79ab524-bc96-45ce-91df-6713d6fcaaaf", "name": "network-vif-plugged", "status": "completed", "tag": "f783de9c-03e4-446f-b34b-e2edaa551d3c"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:52.706605 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:17:52.706605 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:17:52.714758 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-ad493297-08af-412e-b19a-6bcc7c092b45 req-d9b099cf-1d63-400a-bf6d-d71dcc50801a service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:52.715421 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-ad493297-08af-412e-b19a-6bcc7c092b45 req-d9b099cf-1d63-400a-bf6d-d71dcc50801a service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:52.724661 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3bf42e1f-b439-4149-8706-6ba6e76bbb2b tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:52.726598 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-ad493297-08af-412e-b19a-6bcc7c092b45 req-d9b099cf-1d63-400a-bf6d-d71dcc50801a service nova] Creating event network-vif-plugged:f783de9c-03e4-446f-b34b-e2edaa551d3c for instance d79ab524-bc96-45ce-91df-6713d6fcaaaf on hv-cinder-81571 Oct 28 12:17:52.731460 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-ad493297-08af-412e-b19a-6bcc7c092b45 req-d9b099cf-1d63-400a-bf6d-d71dcc50801a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031065 Oct 28 12:17:52.732202 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 406/795] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:17:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:17:52.736041 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3bf42e1f-b439-4149-8706-6ba6e76bbb2b tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 200 len: 1308 microversion: 2.1 time: 0.134131 Oct 28 12:17:52.746165 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 390/796] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:52 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 1308 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:52.757429 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d0d1ae6c-d35f-465b-9c7f-6a2295f94fca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:52.758084 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d0d1ae6c-d35f-465b-9c7f-6a2295f94fca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:52.764046 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d0d1ae6c-d35f-465b-9c7f-6a2295f94fca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:52.764489 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d0d1ae6c-d35f-465b-9c7f-6a2295f94fca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:52.765789 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d0d1ae6c-d35f-465b-9c7f-6a2295f94fca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:52.766209 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d0d1ae6c-d35f-465b-9c7f-6a2295f94fca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:52.896653 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d0d1ae6c-d35f-465b-9c7f-6a2295f94fca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:52.904998 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d0d1ae6c-d35f-465b-9c7f-6a2295f94fca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:52.906583 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d0d1ae6c-d35f-465b-9c7f-6a2295f94fca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:52.907832 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d0d1ae6c-d35f-465b-9c7f-6a2295f94fca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1743 microversion: 2.20 time: 0.154358 Oct 28 12:17:52.908482 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 407/797] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:52 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:17:53.055094 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a36c6353-4ac4-44d6-91fd-0069a06807f5 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:53.055948 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a36c6353-4ac4-44d6-91fd-0069a06807f5 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:53.062692 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a36c6353-4ac4-44d6-91fd-0069a06807f5 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:53.063187 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a36c6353-4ac4-44d6-91fd-0069a06807f5 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:53.063913 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a36c6353-4ac4-44d6-91fd-0069a06807f5 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:53.064509 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a36c6353-4ac4-44d6-91fd-0069a06807f5 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:53.163379 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c34a6adb-8045-4466-a82f-3009194c03ae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:53.164269 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c34a6adb-8045-4466-a82f-3009194c03ae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:53.173054 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c34a6adb-8045-4466-a82f-3009194c03ae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:53.173532 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c34a6adb-8045-4466-a82f-3009194c03ae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:53.174316 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c34a6adb-8045-4466-a82f-3009194c03ae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:53.174760 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c34a6adb-8045-4466-a82f-3009194c03ae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:53.241198 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a36c6353-4ac4-44d6-91fd-0069a06807f5 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:53.248870 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a36c6353-4ac4-44d6-91fd-0069a06807f5 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1315 microversion: 2.1 time: 0.197322 Oct 28 12:17:53.249440 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 391/798] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:53 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:53.264395 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c34a6adb-8045-4466-a82f-3009194c03ae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.104820 Oct 28 12:17:53.265325 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 408/799] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:53 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:17:53.752936 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f25404e5-4f8c-410d-93db-2978d7bc9d48 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:53.753748 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f25404e5-4f8c-410d-93db-2978d7bc9d48 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: 15ebab3a-a58c-4216-862c-564d4d365c37] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:53.759759 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f25404e5-4f8c-410d-93db-2978d7bc9d48 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:53.760198 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f25404e5-4f8c-410d-93db-2978d7bc9d48 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:53.761089 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f25404e5-4f8c-410d-93db-2978d7bc9d48 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:53.761582 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f25404e5-4f8c-410d-93db-2978d7bc9d48 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:53.779722 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-f25404e5-4f8c-410d-93db-2978d7bc9d48 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] HTTP exception thrown: Instance 15ebab3a-a58c-4216-862c-564d4d365c37 could not be found. Oct 28 12:17:53.780310 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f25404e5-4f8c-410d-93db-2978d7bc9d48 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Returning 404 to user: Instance 15ebab3a-a58c-4216-862c-564d4d365c37 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:17:53.781769 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f25404e5-4f8c-410d-93db-2978d7bc9d48 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37" status: 404 len: 111 microversion: 2.1 time: 0.032468 Oct 28 12:17:53.782316 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 392/800] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:53 2021] GET /compute/v2.1/servers/15ebab3a-a58c-4216-862c-564d4d365c37 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:17:53.927034 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4b862142-ed3d-4784-a71e-2f8661dee1d2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:53.928362 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4b862142-ed3d-4784-a71e-2f8661dee1d2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:53.935304 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4b862142-ed3d-4784-a71e-2f8661dee1d2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:53.935953 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4b862142-ed3d-4784-a71e-2f8661dee1d2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:53.937404 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4b862142-ed3d-4784-a71e-2f8661dee1d2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:53.937827 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4b862142-ed3d-4784-a71e-2f8661dee1d2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:54.064733 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4b862142-ed3d-4784-a71e-2f8661dee1d2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:54.073012 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4b862142-ed3d-4784-a71e-2f8661dee1d2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:54.074500 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4b862142-ed3d-4784-a71e-2f8661dee1d2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:54.075678 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4b862142-ed3d-4784-a71e-2f8661dee1d2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1743 microversion: 2.20 time: 0.152691 Oct 28 12:17:54.076234 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 409/801] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:53 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:17:54.266867 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0990dcb5-e980-480b-941f-dc6f369225af tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:54.267579 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0990dcb5-e980-480b-941f-dc6f369225af tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:54.273821 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0990dcb5-e980-480b-941f-dc6f369225af tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:54.274350 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0990dcb5-e980-480b-941f-dc6f369225af tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:54.275217 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0990dcb5-e980-480b-941f-dc6f369225af tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:54.275646 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0990dcb5-e980-480b-941f-dc6f369225af tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:54.277584 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-29b283aa-b022-406d-b426-6c7dc69aa224 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:54.278587 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-29b283aa-b022-406d-b426-6c7dc69aa224 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:54.285502 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29b283aa-b022-406d-b426-6c7dc69aa224 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:54.286068 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29b283aa-b022-406d-b426-6c7dc69aa224 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:54.286971 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29b283aa-b022-406d-b426-6c7dc69aa224 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:54.287504 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29b283aa-b022-406d-b426-6c7dc69aa224 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:54.353801 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-29b283aa-b022-406d-b426-6c7dc69aa224 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.079973 Oct 28 12:17:54.357786 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 410/802] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:54 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:17:54.403003 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0990dcb5-e980-480b-941f-dc6f369225af tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:54.410993 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0990dcb5-e980-480b-941f-dc6f369225af tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1465 microversion: 2.1 time: 0.147843 Oct 28 12:17:54.411549 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 393/803] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:54 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1465 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:54.450722 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-19edc575-a640-4464-afb6-d2bd180dc597 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:54.451301 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-19edc575-a640-4464-afb6-d2bd180dc597 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:54.458455 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-19edc575-a640-4464-afb6-d2bd180dc597 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:54.458934 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-19edc575-a640-4464-afb6-d2bd180dc597 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:54.459695 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-19edc575-a640-4464-afb6-d2bd180dc597 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:54.460122 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-19edc575-a640-4464-afb6-d2bd180dc597 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:54.486628 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-19edc575-a640-4464-afb6-d2bd180dc597 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:17:54.563301 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-19edc575-a640-4464-afb6-d2bd180dc597 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "DELETE /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 204 len: 0 microversion: 2.1 time: 0.116210 Oct 28 12:17:54.566774 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 411/804] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:17:54 2021] DELETE /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:17:54.574632 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a2b567e2-9303-4e9d-941e-06bc29c891f6 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:54.575262 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a2b567e2-9303-4e9d-941e-06bc29c891f6 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:54.581443 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a2b567e2-9303-4e9d-941e-06bc29c891f6 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:54.581888 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a2b567e2-9303-4e9d-941e-06bc29c891f6 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:54.582653 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a2b567e2-9303-4e9d-941e-06bc29c891f6 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:54.583114 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a2b567e2-9303-4e9d-941e-06bc29c891f6 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:54.708903 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a2b567e2-9303-4e9d-941e-06bc29c891f6 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:54.716119 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a2b567e2-9303-4e9d-941e-06bc29c891f6 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1471 microversion: 2.1 time: 0.145207 Oct 28 12:17:54.716680 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 394/805] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:54 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1471 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:55.097722 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2c618dbb-40f0-491e-9233-be074bea2047 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:55.098411 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2c618dbb-40f0-491e-9233-be074bea2047 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:55.104722 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c618dbb-40f0-491e-9233-be074bea2047 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:55.105175 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c618dbb-40f0-491e-9233-be074bea2047 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:55.105939 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c618dbb-40f0-491e-9233-be074bea2047 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:55.106443 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c618dbb-40f0-491e-9233-be074bea2047 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:55.246585 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2c618dbb-40f0-491e-9233-be074bea2047 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:55.256444 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2c618dbb-40f0-491e-9233-be074bea2047 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:55.257937 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2c618dbb-40f0-491e-9233-be074bea2047 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:55.259258 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2c618dbb-40f0-491e-9233-be074bea2047 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1743 microversion: 2.20 time: 0.166193 Oct 28 12:17:55.266382 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 412/806] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:55 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1743 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:17:55.365141 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0c0662e0-7707-4bda-9c86-773845fe0291 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:55.366034 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0c0662e0-7707-4bda-9c86-773845fe0291 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:55.372127 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0c0662e0-7707-4bda-9c86-773845fe0291 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:55.372562 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0c0662e0-7707-4bda-9c86-773845fe0291 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:55.373316 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0c0662e0-7707-4bda-9c86-773845fe0291 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:55.373739 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0c0662e0-7707-4bda-9c86-773845fe0291 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:55.733187 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-49d40108-8d33-4e8c-aa09-632134f267cd tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:55.733788 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-49d40108-8d33-4e8c-aa09-632134f267cd tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:55.740149 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-49d40108-8d33-4e8c-aa09-632134f267cd tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:55.740589 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-49d40108-8d33-4e8c-aa09-632134f267cd tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:55.741351 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-49d40108-8d33-4e8c-aa09-632134f267cd tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:55.741778 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-49d40108-8d33-4e8c-aa09-632134f267cd tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:55.863076 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-49d40108-8d33-4e8c-aa09-632134f267cd tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:55.870940 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-49d40108-8d33-4e8c-aa09-632134f267cd tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1471 microversion: 2.1 time: 0.141405 Oct 28 12:17:55.871518 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 413/807] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:55 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1471 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:17:56.277011 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cb46bbba-5e06-4f5d-a112-8d073222d83f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:56.277690 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cb46bbba-5e06-4f5d-a112-8d073222d83f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:56.283913 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb46bbba-5e06-4f5d-a112-8d073222d83f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:56.284354 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb46bbba-5e06-4f5d-a112-8d073222d83f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:56.285118 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb46bbba-5e06-4f5d-a112-8d073222d83f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:56.285540 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb46bbba-5e06-4f5d-a112-8d073222d83f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:56.403648 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cb46bbba-5e06-4f5d-a112-8d073222d83f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:56.411309 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cb46bbba-5e06-4f5d-a112-8d073222d83f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:56.412779 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cb46bbba-5e06-4f5d-a112-8d073222d83f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:56.413927 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cb46bbba-5e06-4f5d-a112-8d073222d83f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1743 microversion: 2.20 time: 0.140677 Oct 28 12:17:56.414477 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 414/808] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:56 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1743 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:17:56.888532 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-54e7f3a5-5906-452c-a640-4adad1185c28 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:56.889228 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-54e7f3a5-5906-452c-a640-4adad1185c28 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:56.895434 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54e7f3a5-5906-452c-a640-4adad1185c28 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:56.895874 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54e7f3a5-5906-452c-a640-4adad1185c28 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:56.897334 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54e7f3a5-5906-452c-a640-4adad1185c28 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:56.897867 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54e7f3a5-5906-452c-a640-4adad1185c28 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:57.021653 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-54e7f3a5-5906-452c-a640-4adad1185c28 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:57.029018 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-54e7f3a5-5906-452c-a640-4adad1185c28 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1471 microversion: 2.1 time: 0.144132 Oct 28 12:17:57.029582 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 415/809] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:56 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1471 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:17:57.432271 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6de8b89c-3c91-4b06-964c-d03eaa4e51cf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:57.432851 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6de8b89c-3c91-4b06-964c-d03eaa4e51cf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:57.439624 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6de8b89c-3c91-4b06-964c-d03eaa4e51cf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:57.440060 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6de8b89c-3c91-4b06-964c-d03eaa4e51cf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:57.440819 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6de8b89c-3c91-4b06-964c-d03eaa4e51cf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:57.441246 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6de8b89c-3c91-4b06-964c-d03eaa4e51cf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:57.557773 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6de8b89c-3c91-4b06-964c-d03eaa4e51cf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:57.566029 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6de8b89c-3c91-4b06-964c-d03eaa4e51cf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:57.567549 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6de8b89c-3c91-4b06-964c-d03eaa4e51cf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:57.568694 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6de8b89c-3c91-4b06-964c-d03eaa4e51cf tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1743 microversion: 2.20 time: 0.140140 Oct 28 12:17:57.569242 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 416/810] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:57 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1743 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:17:58.045495 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-75a702b4-8c6f-4498-82b1-98a93f865856 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:58.046134 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-75a702b4-8c6f-4498-82b1-98a93f865856 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:58.052142 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-75a702b4-8c6f-4498-82b1-98a93f865856 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:58.052588 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-75a702b4-8c6f-4498-82b1-98a93f865856 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:58.053359 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-75a702b4-8c6f-4498-82b1-98a93f865856 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:58.053788 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-75a702b4-8c6f-4498-82b1-98a93f865856 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:58.177519 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-75a702b4-8c6f-4498-82b1-98a93f865856 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:58.184766 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-75a702b4-8c6f-4498-82b1-98a93f865856 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1471 microversion: 2.1 time: 0.143267 Oct 28 12:17:58.185330 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 417/811] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:58 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1471 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:17:58.586777 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-07a41781-f0e6-479b-b678-76ee493db7d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:58.587399 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-07a41781-f0e6-479b-b678-76ee493db7d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:58.594661 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-07a41781-f0e6-479b-b678-76ee493db7d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:58.595144 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-07a41781-f0e6-479b-b678-76ee493db7d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:58.596148 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-07a41781-f0e6-479b-b678-76ee493db7d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:58.596617 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-07a41781-f0e6-479b-b678-76ee493db7d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:58.720781 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0c0662e0-7707-4bda-9c86-773845fe0291 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 3.359135 Oct 28 12:17:58.725099 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 395/812] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:55 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 3361 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:17:58.726601 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-07a41781-f0e6-479b-b678-76ee493db7d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:58.735243 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-07a41781-f0e6-479b-b678-76ee493db7d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:58.736717 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-07a41781-f0e6-479b-b678-76ee493db7d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:58.737890 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-07a41781-f0e6-479b-b678-76ee493db7d9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1743 microversion: 2.20 time: 0.154883 Oct 28 12:17:58.738441 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 418/813] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:58 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:17:59.203781 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-24e7be83-2205-4976-ba45-2eb60dba7541 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:59.204694 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-24e7be83-2205-4976-ba45-2eb60dba7541 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:59.211720 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-24e7be83-2205-4976-ba45-2eb60dba7541 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:59.212170 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-24e7be83-2205-4976-ba45-2eb60dba7541 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:59.212943 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-24e7be83-2205-4976-ba45-2eb60dba7541 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:59.213370 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-24e7be83-2205-4976-ba45-2eb60dba7541 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:59.342881 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-24e7be83-2205-4976-ba45-2eb60dba7541 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:59.351455 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-24e7be83-2205-4976-ba45-2eb60dba7541 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1471 microversion: 2.1 time: 0.152149 Oct 28 12:17:59.352259 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 396/814] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:17:59 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:17:59.733884 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-37b31780-9b64-4a28-adf2-bccaeac2c2a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:17:59.735634 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-37b31780-9b64-4a28-adf2-bccaeac2c2a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:59.741937 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-37b31780-9b64-4a28-adf2-bccaeac2c2a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:59.742579 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-37b31780-9b64-4a28-adf2-bccaeac2c2a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:59.743564 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-37b31780-9b64-4a28-adf2-bccaeac2c2a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:59.744142 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-37b31780-9b64-4a28-adf2-bccaeac2c2a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:59.756131 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cfea72e7-9f56-4810-ba99-48871376e229 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:17:59.756835 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cfea72e7-9f56-4810-ba99-48871376e229 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:17:59.767023 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cfea72e7-9f56-4810-ba99-48871376e229 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:59.768530 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cfea72e7-9f56-4810-ba99-48871376e229 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:59.769525 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cfea72e7-9f56-4810-ba99-48871376e229 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:17:59.769968 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cfea72e7-9f56-4810-ba99-48871376e229 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:17:59.817069 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-37b31780-9b64-4a28-adf2-bccaeac2c2a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.087697 Oct 28 12:17:59.819062 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 419/815] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:17:59 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:17:59.948461 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-cfea72e7-9f56-4810-ba99-48871376e229 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:59.961256 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-cfea72e7-9f56-4810-ba99-48871376e229 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:59.964756 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-cfea72e7-9f56-4810-ba99-48871376e229 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:17:59.968217 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cfea72e7-9f56-4810-ba99-48871376e229 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1738 microversion: 2.20 time: 0.215545 Oct 28 12:17:59.969952 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 397/816] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:17:59 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:00.375083 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f5f3a5a2-d29d-4663-9358-a80fd8d1f8b7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:00.375764 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f5f3a5a2-d29d-4663-9358-a80fd8d1f8b7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:00.384805 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f5f3a5a2-d29d-4663-9358-a80fd8d1f8b7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:00.385341 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f5f3a5a2-d29d-4663-9358-a80fd8d1f8b7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:00.386325 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f5f3a5a2-d29d-4663-9358-a80fd8d1f8b7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:00.386955 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f5f3a5a2-d29d-4663-9358-a80fd8d1f8b7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:00.589849 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f5f3a5a2-d29d-4663-9358-a80fd8d1f8b7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:00.599091 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f5f3a5a2-d29d-4663-9358-a80fd8d1f8b7 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1471 microversion: 2.1 time: 0.233866 Oct 28 12:18:00.600228 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 420/817] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:00 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1471 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:00.829091 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-271a8bb5-8e34-449f-9a52-d54312f80beb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:00.831308 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-271a8bb5-8e34-449f-9a52-d54312f80beb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:00.837805 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-271a8bb5-8e34-449f-9a52-d54312f80beb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:00.838240 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-271a8bb5-8e34-449f-9a52-d54312f80beb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:00.839214 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-271a8bb5-8e34-449f-9a52-d54312f80beb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:00.839857 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-271a8bb5-8e34-449f-9a52-d54312f80beb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:00.988640 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c6a887c7-c7ca-4747-af19-9f1268244b34 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:00.989542 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c6a887c7-c7ca-4747-af19-9f1268244b34 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:00.995859 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6a887c7-c7ca-4747-af19-9f1268244b34 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:00.996648 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6a887c7-c7ca-4747-af19-9f1268244b34 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:00.998266 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6a887c7-c7ca-4747-af19-9f1268244b34 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:00.999496 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6a887c7-c7ca-4747-af19-9f1268244b34 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:01.128783 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c6a887c7-c7ca-4747-af19-9f1268244b34 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:01.136642 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c6a887c7-c7ca-4747-af19-9f1268244b34 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:01.138118 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c6a887c7-c7ca-4747-af19-9f1268244b34 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:01.139325 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c6a887c7-c7ca-4747-af19-9f1268244b34 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1738 microversion: 2.20 time: 0.155275 Oct 28 12:18:01.139905 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 421/818] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:00 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:01.212720 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-271a8bb5-8e34-449f-9a52-d54312f80beb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.387686 Oct 28 12:18:01.217221 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 398/819] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:00 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:01.449965 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-80185161-efb2-4707-a453-02a182ca304d req-a95371c5-9755-4e61-9eaa-bedf205337b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94e10a41-d291-42ca-a7e6-2fb621dc259e", "name": "network-vif-deleted", "tag": "a8d48b1b-1297-449d-869b-dde209a1c611"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:01.451616 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:18:01.451616 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:18:01.468566 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-80185161-efb2-4707-a453-02a182ca304d req-a95371c5-9755-4e61-9eaa-bedf205337b1 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:01.469347 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-80185161-efb2-4707-a453-02a182ca304d req-a95371c5-9755-4e61-9eaa-bedf205337b1 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:01.481478 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-80185161-efb2-4707-a453-02a182ca304d req-a95371c5-9755-4e61-9eaa-bedf205337b1 service nova] Creating event network-vif-deleted:a8d48b1b-1297-449d-869b-dde209a1c611 for instance 94e10a41-d291-42ca-a7e6-2fb621dc259e on hv-cinder-81571 Oct 28 12:18:01.487170 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-80185161-efb2-4707-a453-02a182ca304d req-a95371c5-9755-4e61-9eaa-bedf205337b1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199383 Oct 28 12:18:01.488000 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 422/820] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:18:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:18:01.621020 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-beae8b9e-c3f6-42c9-8fd9-4cd1720847d5 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:01.621720 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-beae8b9e-c3f6-42c9-8fd9-4cd1720847d5 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:01.628690 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-beae8b9e-c3f6-42c9-8fd9-4cd1720847d5 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:01.629402 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-beae8b9e-c3f6-42c9-8fd9-4cd1720847d5 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:01.630394 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-beae8b9e-c3f6-42c9-8fd9-4cd1720847d5 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:01.630922 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-beae8b9e-c3f6-42c9-8fd9-4cd1720847d5 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:01.701415 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-beae8b9e-c3f6-42c9-8fd9-4cd1720847d5 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:01.711029 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-beae8b9e-c3f6-42c9-8fd9-4cd1720847d5 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1300 microversion: 2.1 time: 0.094336 Oct 28 12:18:01.711934 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 399/821] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:01 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:02.159304 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-61fe68ca-692c-4ef3-bffe-f4cb24d8ec60 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:02.159991 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-61fe68ca-692c-4ef3-bffe-f4cb24d8ec60 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:02.166280 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-61fe68ca-692c-4ef3-bffe-f4cb24d8ec60 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:02.166753 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-61fe68ca-692c-4ef3-bffe-f4cb24d8ec60 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:02.167522 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-61fe68ca-692c-4ef3-bffe-f4cb24d8ec60 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:02.167950 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-61fe68ca-692c-4ef3-bffe-f4cb24d8ec60 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:02.224466 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8104f90e-8445-4f17-b881-e31bda869e01 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:02.226231 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8104f90e-8445-4f17-b881-e31bda869e01 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:02.232827 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8104f90e-8445-4f17-b881-e31bda869e01 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:02.233637 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8104f90e-8445-4f17-b881-e31bda869e01 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:02.234780 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8104f90e-8445-4f17-b881-e31bda869e01 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:02.235509 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8104f90e-8445-4f17-b881-e31bda869e01 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:02.354801 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-61fe68ca-692c-4ef3-bffe-f4cb24d8ec60 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:02.362503 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-61fe68ca-692c-4ef3-bffe-f4cb24d8ec60 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:02.364012 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-61fe68ca-692c-4ef3-bffe-f4cb24d8ec60 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:02.365147 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-61fe68ca-692c-4ef3-bffe-f4cb24d8ec60 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1738 microversion: 2.20 time: 0.210965 Oct 28 12:18:02.365702 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 423/822] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:02 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:02.729506 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d81e0f86-ee39-4eb6-b1cb-ec092dd905bd tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:02.730163 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d81e0f86-ee39-4eb6-b1cb-ec092dd905bd tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:02.743164 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d81e0f86-ee39-4eb6-b1cb-ec092dd905bd tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:02.744688 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d81e0f86-ee39-4eb6-b1cb-ec092dd905bd tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:02.745505 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d81e0f86-ee39-4eb6-b1cb-ec092dd905bd tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:02.745932 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d81e0f86-ee39-4eb6-b1cb-ec092dd905bd tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:02.790560 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d81e0f86-ee39-4eb6-b1cb-ec092dd905bd tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:02.790943 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d81e0f86-ee39-4eb6-b1cb-ec092dd905bd tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:02.791376 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-d81e0f86-ee39-4eb6-b1cb-ec092dd905bd tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lazy-loading 'fault' on Instance uuid 94e10a41-d291-42ca-a7e6-2fb621dc259e {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:18:02.836357 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d81e0f86-ee39-4eb6-b1cb-ec092dd905bd tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:02.844075 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d81e0f86-ee39-4eb6-b1cb-ec092dd905bd tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1305 microversion: 2.1 time: 0.119415 Oct 28 12:18:02.844650 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 424/823] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:02 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1305 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:03.383966 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-60379994-33f3-47fa-bef0-4e9f0a7d64c8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:03.384665 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-60379994-33f3-47fa-bef0-4e9f0a7d64c8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:03.392036 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60379994-33f3-47fa-bef0-4e9f0a7d64c8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:03.392484 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60379994-33f3-47fa-bef0-4e9f0a7d64c8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:03.393380 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60379994-33f3-47fa-bef0-4e9f0a7d64c8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:03.393698 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60379994-33f3-47fa-bef0-4e9f0a7d64c8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:03.518579 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-60379994-33f3-47fa-bef0-4e9f0a7d64c8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:03.533834 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-60379994-33f3-47fa-bef0-4e9f0a7d64c8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:03.539046 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-60379994-33f3-47fa-bef0-4e9f0a7d64c8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:03.541383 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-60379994-33f3-47fa-bef0-4e9f0a7d64c8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1738 microversion: 2.20 time: 0.160905 Oct 28 12:18:03.542714 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 425/824] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:03 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:03.861069 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f305cfe0-2bf9-4299-b6b6-25aca18511cf tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:03.861690 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f305cfe0-2bf9-4299-b6b6-25aca18511cf tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:03.875706 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f305cfe0-2bf9-4299-b6b6-25aca18511cf tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:03.876144 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f305cfe0-2bf9-4299-b6b6-25aca18511cf tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:03.877461 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f305cfe0-2bf9-4299-b6b6-25aca18511cf tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:03.877461 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f305cfe0-2bf9-4299-b6b6-25aca18511cf tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:03.927662 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f305cfe0-2bf9-4299-b6b6-25aca18511cf tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:03.928101 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f305cfe0-2bf9-4299-b6b6-25aca18511cf tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:03.928544 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-f305cfe0-2bf9-4299-b6b6-25aca18511cf tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lazy-loading 'fault' on Instance uuid 94e10a41-d291-42ca-a7e6-2fb621dc259e {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:18:03.981854 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f305cfe0-2bf9-4299-b6b6-25aca18511cf tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:03.995168 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f305cfe0-2bf9-4299-b6b6-25aca18511cf tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1305 microversion: 2.1 time: 0.137498 Oct 28 12:18:03.996218 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 426/825] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:03 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1305 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:04.560837 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4c10caec-9a25-4a60-a3ef-e9c599f48db2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:04.561481 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4c10caec-9a25-4a60-a3ef-e9c599f48db2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:04.568329 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4c10caec-9a25-4a60-a3ef-e9c599f48db2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:04.569051 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4c10caec-9a25-4a60-a3ef-e9c599f48db2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:04.569936 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4c10caec-9a25-4a60-a3ef-e9c599f48db2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:04.570477 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4c10caec-9a25-4a60-a3ef-e9c599f48db2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:04.714601 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4c10caec-9a25-4a60-a3ef-e9c599f48db2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:04.726610 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4c10caec-9a25-4a60-a3ef-e9c599f48db2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:04.728305 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4c10caec-9a25-4a60-a3ef-e9c599f48db2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:04.730799 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4c10caec-9a25-4a60-a3ef-e9c599f48db2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1738 microversion: 2.20 time: 0.173069 Oct 28 12:18:04.731433 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 427/826] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:04 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:04.966927 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8104f90e-8445-4f17-b881-e31bda869e01 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 2.745950 Oct 28 12:18:04.972114 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 400/827] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:02 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 2749 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:05.016273 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9fa83722-2486-4c35-9e89-ebcc3919f294 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:05.017504 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9fa83722-2486-4c35-9e89-ebcc3919f294 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:05.030952 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9fa83722-2486-4c35-9e89-ebcc3919f294 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:05.034438 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9fa83722-2486-4c35-9e89-ebcc3919f294 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:05.035543 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9fa83722-2486-4c35-9e89-ebcc3919f294 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:05.035979 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9fa83722-2486-4c35-9e89-ebcc3919f294 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:05.075485 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9fa83722-2486-4c35-9e89-ebcc3919f294 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:05.075926 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9fa83722-2486-4c35-9e89-ebcc3919f294 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:05.076364 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-9fa83722-2486-4c35-9e89-ebcc3919f294 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lazy-loading 'fault' on Instance uuid 94e10a41-d291-42ca-a7e6-2fb621dc259e {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:18:05.118287 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9fa83722-2486-4c35-9e89-ebcc3919f294 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c358852fa98945578fea3220025bb7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50051562634a79a6c3c9df62bee279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:05.126902 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9fa83722-2486-4c35-9e89-ebcc3919f294 tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 200 len: 1305 microversion: 2.1 time: 0.117158 Oct 28 12:18:05.127351 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 428/828] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:05 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 1305 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:05.755473 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2f64ecd8-6bb6-42f5-916f-b64da42335fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:05.756178 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2f64ecd8-6bb6-42f5-916f-b64da42335fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:05.763763 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f64ecd8-6bb6-42f5-916f-b64da42335fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:05.764931 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f64ecd8-6bb6-42f5-916f-b64da42335fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:05.765830 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f64ecd8-6bb6-42f5-916f-b64da42335fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:05.766335 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f64ecd8-6bb6-42f5-916f-b64da42335fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:05.873736 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-70bd92a6-d79b-407a-8d5f-2a892c6c58d5 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-494936828", "imageRef": "4385a199-a3e9-4c11-b580-60e7a24d0e97", "flavorRef": "452", "networks": [{"uuid": "abc19093-1431-4203-8ce3-8a0c45f089be"}]}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:05.954739 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-70bd92a6-d79b-407a-8d5f-2a892c6c58d5 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] validate_networks() for [('abc19093-1431-4203-8ce3-8a0c45f089be', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:18:05.992976 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2f64ecd8-6bb6-42f5-916f-b64da42335fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:06.002197 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2f64ecd8-6bb6-42f5-916f-b64da42335fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:06.003723 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2f64ecd8-6bb6-42f5-916f-b64da42335fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:06.005285 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2f64ecd8-6bb6-42f5-916f-b64da42335fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1738 microversion: 2.20 time: 0.257905 Oct 28 12:18:06.006339 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 401/829] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:05 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:06.011778 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-62d30d8d-0a54-49c6-8727-1066adce56ac tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:06.011992 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-62d30d8d-0a54-49c6-8727-1066adce56ac tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:06.018638 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-62d30d8d-0a54-49c6-8727-1066adce56ac tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:06.019116 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-62d30d8d-0a54-49c6-8727-1066adce56ac tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:06.022334 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-62d30d8d-0a54-49c6-8727-1066adce56ac tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:06.022334 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-62d30d8d-0a54-49c6-8727-1066adce56ac tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:06.114803 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-62d30d8d-0a54-49c6-8727-1066adce56ac tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.107012 Oct 28 12:18:06.116111 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 402/830] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:06 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:06.150061 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bc2891d4-8c04-4c39-bc00-e976052909af tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:06.151016 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bc2891d4-8c04-4c39-bc00-e976052909af tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] [instance: 94e10a41-d291-42ca-a7e6-2fb621dc259e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:06.157946 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc2891d4-8c04-4c39-bc00-e976052909af tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:06.158524 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc2891d4-8c04-4c39-bc00-e976052909af tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:06.159426 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc2891d4-8c04-4c39-bc00-e976052909af tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:06.160102 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc2891d4-8c04-4c39-bc00-e976052909af tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:06.186665 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-bc2891d4-8c04-4c39-bc00-e976052909af tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] HTTP exception thrown: Instance 94e10a41-d291-42ca-a7e6-2fb621dc259e could not be found. Oct 28 12:18:06.187566 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bc2891d4-8c04-4c39-bc00-e976052909af tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] Returning 404 to user: Instance 94e10a41-d291-42ca-a7e6-2fb621dc259e could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:18:06.188872 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bc2891d4-8c04-4c39-bc00-e976052909af tempest-VolumesNegativeTest-813189431 tempest-VolumesNegativeTest-813189431-project] 10.222.0.37 "GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e" status: 404 len: 111 microversion: 2.1 time: 0.046382 Oct 28 12:18:06.189896 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 403/831] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:06 2021] GET /compute/v2.1/servers/94e10a41-d291-42ca-a7e6-2fb621dc259e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 12:18:06.604821 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-70bd92a6-d79b-407a-8d5f-2a892c6c58d5 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:18:06.605194 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-70bd92a6-d79b-407a-8d5f-2a892c6c58d5 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:18:06.605651 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-70bd92a6-d79b-407a-8d5f-2a892c6c58d5 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:18:06.606239 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-70bd92a6-d79b-407a-8d5f-2a892c6c58d5 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:18:06.606869 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-70bd92a6-d79b-407a-8d5f-2a892c6c58d5 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:18:06.622574 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-70bd92a6-d79b-407a-8d5f-2a892c6c58d5 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:06.623124 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-70bd92a6-d79b-407a-8d5f-2a892c6c58d5 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:06.630135 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-70bd92a6-d79b-407a-8d5f-2a892c6c58d5 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:06.630848 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-70bd92a6-d79b-407a-8d5f-2a892c6c58d5 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:06.649029 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-70bd92a6-d79b-407a-8d5f-2a892c6c58d5 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Getting quotas for project c8940dc0094a47d1a152788282bedb0e. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:18:06.653538 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-70bd92a6-d79b-407a-8d5f-2a892c6c58d5 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Getting quotas for user 3f3b17d1ff60414d898fa16aca182c1c and project c8940dc0094a47d1a152788282bedb0e. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:18:06.667096 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-70bd92a6-d79b-407a-8d5f-2a892c6c58d5 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:18:06.669987 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-70bd92a6-d79b-407a-8d5f-2a892c6c58d5 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4385a199-a3e9-4c11-b580-60e7a24d0e97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:18:06.723286 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-70bd92a6-d79b-407a-8d5f-2a892c6c58d5 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.861826 Oct 28 12:18:06.724450 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 429/832] 10.222.0.37 () {60 vars in 1146 bytes} [Thu Oct 28 12:18:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 12:18:06.734780 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4252d75c-f2c3-4afe-a20d-ac0d9395b100 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:06.735443 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4252d75c-f2c3-4afe-a20d-ac0d9395b100 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:06.799184 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4252d75c-f2c3-4afe-a20d-ac0d9395b100 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:06.807176 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4252d75c-f2c3-4afe-a20d-ac0d9395b100 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1218 microversion: 2.1 time: 0.076943 Oct 28 12:18:06.807973 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 404/833] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:06 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:07.024711 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-46acd901-c8ea-4e91-b111-d192a2c54b5c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:07.026093 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-46acd901-c8ea-4e91-b111-d192a2c54b5c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:07.034072 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-46acd901-c8ea-4e91-b111-d192a2c54b5c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:07.034776 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-46acd901-c8ea-4e91-b111-d192a2c54b5c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:07.035963 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-46acd901-c8ea-4e91-b111-d192a2c54b5c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:07.036554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-46acd901-c8ea-4e91-b111-d192a2c54b5c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:07.127170 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1810ea1d-81f9-4376-a4fc-e053de3f6a4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:07.128124 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1810ea1d-81f9-4376-a4fc-e053de3f6a4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:07.141110 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1810ea1d-81f9-4376-a4fc-e053de3f6a4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:07.141538 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1810ea1d-81f9-4376-a4fc-e053de3f6a4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:07.143653 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1810ea1d-81f9-4376-a4fc-e053de3f6a4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:07.146340 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1810ea1d-81f9-4376-a4fc-e053de3f6a4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:07.243664 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1810ea1d-81f9-4376-a4fc-e053de3f6a4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.119968 Oct 28 12:18:07.251350 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 405/834] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:07 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:07.271026 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-46acd901-c8ea-4e91-b111-d192a2c54b5c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:07.281074 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-46acd901-c8ea-4e91-b111-d192a2c54b5c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:07.283207 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-46acd901-c8ea-4e91-b111-d192a2c54b5c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:07.284566 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-46acd901-c8ea-4e91-b111-d192a2c54b5c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1738 microversion: 2.20 time: 0.264301 Oct 28 12:18:07.286429 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 430/835] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:07 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1738 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:07.824968 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-42dce9fc-68dc-4c31-bb6b-f0d298784ed9 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:07.825693 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-42dce9fc-68dc-4c31-bb6b-f0d298784ed9 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:07.847954 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-42dce9fc-68dc-4c31-bb6b-f0d298784ed9 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:07.848519 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-42dce9fc-68dc-4c31-bb6b-f0d298784ed9 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:07.849470 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-42dce9fc-68dc-4c31-bb6b-f0d298784ed9 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:07.850105 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-42dce9fc-68dc-4c31-bb6b-f0d298784ed9 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:07.953594 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-42dce9fc-68dc-4c31-bb6b-f0d298784ed9 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:07.976234 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-42dce9fc-68dc-4c31-bb6b-f0d298784ed9 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1270 microversion: 2.1 time: 0.154552 Oct 28 12:18:07.979034 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 406/836] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:07 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:08.255518 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-03cb0b1f-499f-4cf9-a340-a1f4a1b00bcf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:08.259166 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-03cb0b1f-499f-4cf9-a340-a1f4a1b00bcf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:08.269923 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-03cb0b1f-499f-4cf9-a340-a1f4a1b00bcf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:08.270462 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-03cb0b1f-499f-4cf9-a340-a1f4a1b00bcf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:08.271612 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-03cb0b1f-499f-4cf9-a340-a1f4a1b00bcf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:08.272398 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-03cb0b1f-499f-4cf9-a340-a1f4a1b00bcf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:08.306698 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c577e4c1-2d4f-4c7c-98be-40dc9adcaf01 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:08.308090 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c577e4c1-2d4f-4c7c-98be-40dc9adcaf01 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:08.319507 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c577e4c1-2d4f-4c7c-98be-40dc9adcaf01 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:08.322022 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c577e4c1-2d4f-4c7c-98be-40dc9adcaf01 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:08.325818 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c577e4c1-2d4f-4c7c-98be-40dc9adcaf01 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:08.326501 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c577e4c1-2d4f-4c7c-98be-40dc9adcaf01 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:08.403281 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-03cb0b1f-499f-4cf9-a340-a1f4a1b00bcf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.151819 Oct 28 12:18:08.403955 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 431/837] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:08 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:08.577746 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c577e4c1-2d4f-4c7c-98be-40dc9adcaf01 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:08.588593 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c577e4c1-2d4f-4c7c-98be-40dc9adcaf01 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:08.590438 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c577e4c1-2d4f-4c7c-98be-40dc9adcaf01 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:08.591975 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c577e4c1-2d4f-4c7c-98be-40dc9adcaf01 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1738 microversion: 2.20 time: 0.291723 Oct 28 12:18:08.593311 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 407/838] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:08 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1738 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:08.997889 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6f8fd5db-e5ac-4975-8dd6-d83fada84be4 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:08.999593 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6f8fd5db-e5ac-4975-8dd6-d83fada84be4 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:09.007575 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6f8fd5db-e5ac-4975-8dd6-d83fada84be4 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:09.008977 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6f8fd5db-e5ac-4975-8dd6-d83fada84be4 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:09.010465 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6f8fd5db-e5ac-4975-8dd6-d83fada84be4 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:09.011504 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6f8fd5db-e5ac-4975-8dd6-d83fada84be4 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:09.219420 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6f8fd5db-e5ac-4975-8dd6-d83fada84be4 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:09.228581 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6f8fd5db-e5ac-4975-8dd6-d83fada84be4 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.234496 Oct 28 12:18:09.239066 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 432/839] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:08 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:09.415672 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e0de7729-cd5d-4b8b-be92-2064d5794166 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:09.416569 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e0de7729-cd5d-4b8b-be92-2064d5794166 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:09.427696 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e0de7729-cd5d-4b8b-be92-2064d5794166 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:09.428234 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e0de7729-cd5d-4b8b-be92-2064d5794166 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:09.429441 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e0de7729-cd5d-4b8b-be92-2064d5794166 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:09.430105 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e0de7729-cd5d-4b8b-be92-2064d5794166 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:09.544791 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e0de7729-cd5d-4b8b-be92-2064d5794166 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.132557 Oct 28 12:18:09.550587 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 408/840] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:09 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:09.612877 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fe76868d-7eca-471c-b987-88240e649cb8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:09.613469 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fe76868d-7eca-471c-b987-88240e649cb8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:09.621597 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe76868d-7eca-471c-b987-88240e649cb8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:09.629416 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe76868d-7eca-471c-b987-88240e649cb8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:09.630773 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe76868d-7eca-471c-b987-88240e649cb8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:09.633704 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fe76868d-7eca-471c-b987-88240e649cb8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:09.960164 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fe76868d-7eca-471c-b987-88240e649cb8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:09.960164 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fe76868d-7eca-471c-b987-88240e649cb8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:09.963238 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fe76868d-7eca-471c-b987-88240e649cb8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:09.965859 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fe76868d-7eca-471c-b987-88240e649cb8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1738 microversion: 2.20 time: 0.356953 Oct 28 12:18:09.967525 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 433/841] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:09 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1738 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:10.247931 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-864f96f6-2b1f-4ac0-aa32-6e817aad1884 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:10.248954 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-864f96f6-2b1f-4ac0-aa32-6e817aad1884 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:10.258903 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-864f96f6-2b1f-4ac0-aa32-6e817aad1884 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:10.259609 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-864f96f6-2b1f-4ac0-aa32-6e817aad1884 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:10.260675 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-864f96f6-2b1f-4ac0-aa32-6e817aad1884 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:10.266244 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-864f96f6-2b1f-4ac0-aa32-6e817aad1884 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:10.302526 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-0892c675-9072-4e2d-84af-b7ef379564ed req-0b689575-ab65-4e81-8463-40e0f9a9b6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea6bc04f-095b-4b34-a107-3dbbd1d776fe", "tag": "cd823aea-fe57-404d-8292-19c6622c9992"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:10.307177 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:18:10.307177 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:18:10.333020 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-0892c675-9072-4e2d-84af-b7ef379564ed req-0b689575-ab65-4e81-8463-40e0f9a9b6c2 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:10.333541 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-0892c675-9072-4e2d-84af-b7ef379564ed req-0b689575-ab65-4e81-8463-40e0f9a9b6c2 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:10.359215 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-0892c675-9072-4e2d-84af-b7ef379564ed req-0b689575-ab65-4e81-8463-40e0f9a9b6c2 service nova] Creating event network-changed:cd823aea-fe57-404d-8292-19c6622c9992 for instance ea6bc04f-095b-4b34-a107-3dbbd1d776fe on hv-cinder-81571 Oct 28 12:18:10.365056 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-0892c675-9072-4e2d-84af-b7ef379564ed req-0b689575-ab65-4e81-8463-40e0f9a9b6c2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068408 Oct 28 12:18:10.367036 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 434/842] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:18:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:18:10.554112 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-864f96f6-2b1f-4ac0-aa32-6e817aad1884 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:10.560147 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c6dc9d86-6ecb-423f-9378-6d76cb2bbd98 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:10.564803 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c6dc9d86-6ecb-423f-9378-6d76cb2bbd98 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:10.568049 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-864f96f6-2b1f-4ac0-aa32-6e817aad1884 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.324936 Oct 28 12:18:10.578622 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6dc9d86-6ecb-423f-9378-6d76cb2bbd98 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:10.579109 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6dc9d86-6ecb-423f-9378-6d76cb2bbd98 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:10.579897 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6dc9d86-6ecb-423f-9378-6d76cb2bbd98 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:10.580714 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6dc9d86-6ecb-423f-9378-6d76cb2bbd98 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:10.583617 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 409/843] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:10 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:10.667045 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c6dc9d86-6ecb-423f-9378-6d76cb2bbd98 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.112375 Oct 28 12:18:10.669044 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 435/844] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:10 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:18:10.987830 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4e379449-d894-4da0-87be-7014b6650e03 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:10.989117 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4e379449-d894-4da0-87be-7014b6650e03 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:10.999534 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e379449-d894-4da0-87be-7014b6650e03 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:11.000807 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e379449-d894-4da0-87be-7014b6650e03 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:11.002859 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e379449-d894-4da0-87be-7014b6650e03 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:11.004188 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4e379449-d894-4da0-87be-7014b6650e03 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:11.246979 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4e379449-d894-4da0-87be-7014b6650e03 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:11.255468 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4e379449-d894-4da0-87be-7014b6650e03 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:11.257468 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4e379449-d894-4da0-87be-7014b6650e03 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:11.259055 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4e379449-d894-4da0-87be-7014b6650e03 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1738 microversion: 2.20 time: 0.276777 Oct 28 12:18:11.282101 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 410/845] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:10 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1738 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:11.589282 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4af13da0-6066-4ed1-999c-e5182e4f2edc tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:11.590109 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4af13da0-6066-4ed1-999c-e5182e4f2edc tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:11.599894 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4af13da0-6066-4ed1-999c-e5182e4f2edc tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:11.600547 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4af13da0-6066-4ed1-999c-e5182e4f2edc tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:11.601541 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4af13da0-6066-4ed1-999c-e5182e4f2edc tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:11.602350 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4af13da0-6066-4ed1-999c-e5182e4f2edc tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:11.679789 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-520a0b6b-78e0-4d5d-9d62-574e13929ac9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:11.680865 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-520a0b6b-78e0-4d5d-9d62-574e13929ac9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:11.687495 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-520a0b6b-78e0-4d5d-9d62-574e13929ac9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:11.687939 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-520a0b6b-78e0-4d5d-9d62-574e13929ac9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:11.688724 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-520a0b6b-78e0-4d5d-9d62-574e13929ac9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:11.689150 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-520a0b6b-78e0-4d5d-9d62-574e13929ac9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:11.818323 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4af13da0-6066-4ed1-999c-e5182e4f2edc tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:11.825965 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4af13da0-6066-4ed1-999c-e5182e4f2edc tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.241440 Oct 28 12:18:11.827063 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 436/846] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:11 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:11.879389 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-520a0b6b-78e0-4d5d-9d62-574e13929ac9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.203265 Oct 28 12:18:11.880626 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 411/847] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:11 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:18:12.277696 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0fd9c2ba-64b9-464f-af48-2a8cc94aa5b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:12.278211 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0fd9c2ba-64b9-464f-af48-2a8cc94aa5b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:12.284743 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0fd9c2ba-64b9-464f-af48-2a8cc94aa5b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:12.285427 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0fd9c2ba-64b9-464f-af48-2a8cc94aa5b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:12.286625 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0fd9c2ba-64b9-464f-af48-2a8cc94aa5b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:12.287653 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0fd9c2ba-64b9-464f-af48-2a8cc94aa5b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:12.417100 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0fd9c2ba-64b9-464f-af48-2a8cc94aa5b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:12.426340 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0fd9c2ba-64b9-464f-af48-2a8cc94aa5b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:12.427898 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0fd9c2ba-64b9-464f-af48-2a8cc94aa5b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:12.429061 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0fd9c2ba-64b9-464f-af48-2a8cc94aa5b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1720 microversion: 2.20 time: 0.155181 Oct 28 12:18:12.429614 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 437/848] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:12 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:12.844303 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-251a05df-6c33-402e-a679-fb1bfe1ea1bd tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:12.845532 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-251a05df-6c33-402e-a679-fb1bfe1ea1bd tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:12.853296 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-251a05df-6c33-402e-a679-fb1bfe1ea1bd tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:12.854062 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-251a05df-6c33-402e-a679-fb1bfe1ea1bd tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:12.855058 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-251a05df-6c33-402e-a679-fb1bfe1ea1bd tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:12.855565 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-251a05df-6c33-402e-a679-fb1bfe1ea1bd tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:12.891895 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-05ac9934-9a5b-4c6e-aceb-d4cb99c1890b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:12.893430 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-05ac9934-9a5b-4c6e-aceb-d4cb99c1890b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:12.901154 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05ac9934-9a5b-4c6e-aceb-d4cb99c1890b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:12.901596 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05ac9934-9a5b-4c6e-aceb-d4cb99c1890b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:12.902377 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05ac9934-9a5b-4c6e-aceb-d4cb99c1890b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:12.902835 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-05ac9934-9a5b-4c6e-aceb-d4cb99c1890b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:13.030086 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-251a05df-6c33-402e-a679-fb1bfe1ea1bd tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:13.037432 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-251a05df-6c33-402e-a679-fb1bfe1ea1bd tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.197670 Oct 28 12:18:13.038095 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 412/849] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:12 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:13.078192 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-05ac9934-9a5b-4c6e-aceb-d4cb99c1890b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.190241 Oct 28 12:18:13.078869 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 438/850] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:12 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:18:13.448399 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ae08396f-e41e-4e40-807f-89c8baa0cd07 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:13.448809 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ae08396f-e41e-4e40-807f-89c8baa0cd07 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:13.455839 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ae08396f-e41e-4e40-807f-89c8baa0cd07 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:13.456274 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ae08396f-e41e-4e40-807f-89c8baa0cd07 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:13.457032 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ae08396f-e41e-4e40-807f-89c8baa0cd07 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:13.457456 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ae08396f-e41e-4e40-807f-89c8baa0cd07 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:13.589067 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ae08396f-e41e-4e40-807f-89c8baa0cd07 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:13.596724 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ae08396f-e41e-4e40-807f-89c8baa0cd07 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:13.598255 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ae08396f-e41e-4e40-807f-89c8baa0cd07 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:13.599739 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ae08396f-e41e-4e40-807f-89c8baa0cd07 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1720 microversion: 2.20 time: 0.155574 Oct 28 12:18:13.600288 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 413/851] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:13 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:14.054803 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9546f48b-8280-4806-ba23-fe3b3782f55c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:14.055541 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9546f48b-8280-4806-ba23-fe3b3782f55c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:14.062842 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9546f48b-8280-4806-ba23-fe3b3782f55c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:14.063291 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9546f48b-8280-4806-ba23-fe3b3782f55c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:14.064059 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9546f48b-8280-4806-ba23-fe3b3782f55c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:14.064495 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9546f48b-8280-4806-ba23-fe3b3782f55c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:14.089341 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8e68df5f-b0ea-4b8e-822e-6193a9f4da4b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:14.090387 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8e68df5f-b0ea-4b8e-822e-6193a9f4da4b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:14.096553 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8e68df5f-b0ea-4b8e-822e-6193a9f4da4b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:14.096988 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8e68df5f-b0ea-4b8e-822e-6193a9f4da4b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:14.097746 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8e68df5f-b0ea-4b8e-822e-6193a9f4da4b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:14.098170 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8e68df5f-b0ea-4b8e-822e-6193a9f4da4b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:14.188241 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9546f48b-8280-4806-ba23-fe3b3782f55c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:14.191874 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8e68df5f-b0ea-4b8e-822e-6193a9f4da4b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.105989 Oct 28 12:18:14.196044 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 414/852] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:14 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:14.196188 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9546f48b-8280-4806-ba23-fe3b3782f55c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.145246 Oct 28 12:18:14.196537 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 439/853] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:14 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:14.618414 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-be7f82e6-8127-4e1f-980f-75bca938941d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:14.619195 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-be7f82e6-8127-4e1f-980f-75bca938941d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:14.625929 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-be7f82e6-8127-4e1f-980f-75bca938941d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:14.626371 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-be7f82e6-8127-4e1f-980f-75bca938941d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:14.627152 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-be7f82e6-8127-4e1f-980f-75bca938941d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:14.627584 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-be7f82e6-8127-4e1f-980f-75bca938941d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:14.758158 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-be7f82e6-8127-4e1f-980f-75bca938941d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:14.766970 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-be7f82e6-8127-4e1f-980f-75bca938941d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:14.768453 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-be7f82e6-8127-4e1f-980f-75bca938941d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:14.769590 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-be7f82e6-8127-4e1f-980f-75bca938941d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1723 microversion: 2.20 time: 0.155247 Oct 28 12:18:14.770151 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 415/854] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:14 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:14.787537 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a85fe9b2-57f9-4e54-bd4f-8f6e2a23978b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff763d94-5640-46b8-88ca-76f385e94cf4"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:14.788580 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a85fe9b2-57f9-4e54-bd4f-8f6e2a23978b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:14.794909 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a85fe9b2-57f9-4e54-bd4f-8f6e2a23978b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:14.795624 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a85fe9b2-57f9-4e54-bd4f-8f6e2a23978b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:14.796389 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a85fe9b2-57f9-4e54-bd4f-8f6e2a23978b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:14.796821 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a85fe9b2-57f9-4e54-bd4f-8f6e2a23978b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:15.032721 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bfffede9-7b65-4434-8865-8262cbd578b3 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-839999252", "imageRef": "4385a199-a3e9-4c11-b580-60e7a24d0e97", "flavorRef": "452", "networks": [{"uuid": "572ded8c-dc2b-4461-bf0f-b2ba86459f25"}]}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:15.081983 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a85fe9b2-57f9-4e54-bd4f-8f6e2a23978b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.298149 Oct 28 12:18:15.083254 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 440/855] 10.222.0.37 () {62 vars in 1363 bytes} [Thu Oct 28 12:18:14 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/os-volume_attachments => generated 188 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:15.100162 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-bfffede9-7b65-4434-8865-8262cbd578b3 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] validate_networks() for [('572ded8c-dc2b-4461-bf0f-b2ba86459f25', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:18:15.200185 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-21107a17-892d-4fb0-b6b1-a1e272562c42 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:15.200751 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-21107a17-892d-4fb0-b6b1-a1e272562c42 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:15.209508 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-21107a17-892d-4fb0-b6b1-a1e272562c42 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:15.209948 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-21107a17-892d-4fb0-b6b1-a1e272562c42 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:15.210761 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-21107a17-892d-4fb0-b6b1-a1e272562c42 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:15.211315 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-21107a17-892d-4fb0-b6b1-a1e272562c42 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:15.309828 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-21107a17-892d-4fb0-b6b1-a1e272562c42 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action" status: 202 len: 0 microversion: 2.20 time: 0.113286 Oct 28 12:18:15.311702 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 441/856] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:18:15 2021] POST /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:18:15.455482 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-99d5369e-6e82-479b-85c1-c7be75441562 req-4762e550-cb71-4994-8220-9505b3417d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79ab524-bc96-45ce-91df-6713d6fcaaaf", "name": "network-vif-unplugged", "status": "completed", "tag": "f783de9c-03e4-446f-b34b-e2edaa551d3c"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:15.457642 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:18:15.457642 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:18:15.467303 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-99d5369e-6e82-479b-85c1-c7be75441562 req-4762e550-cb71-4994-8220-9505b3417d14 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:15.467748 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-99d5369e-6e82-479b-85c1-c7be75441562 req-4762e550-cb71-4994-8220-9505b3417d14 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:15.478817 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.compute.server_external_events [req-99d5369e-6e82-479b-85c1-c7be75441562 req-4762e550-cb71-4994-8220-9505b3417d14 service nova] Unable to find a host for instance d79ab524-bc96-45ce-91df-6713d6fcaaaf. Dropping event network-vif-unplugged {{(pid=115797) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 28 12:18:15.479698 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-99d5369e-6e82-479b-85c1-c7be75441562 req-4762e550-cb71-4994-8220-9505b3417d14 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.167062 Oct 28 12:18:15.480285 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 442/857] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:18:15 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 168 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 12:18:15.485613 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d1f4c6bc-2e16-4b8d-91e6-6ec58f134093 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:15.486533 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d1f4c6bc-2e16-4b8d-91e6-6ec58f134093 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:15.492472 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1f4c6bc-2e16-4b8d-91e6-6ec58f134093 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:15.493138 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1f4c6bc-2e16-4b8d-91e6-6ec58f134093 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:15.493989 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1f4c6bc-2e16-4b8d-91e6-6ec58f134093 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:15.494496 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1f4c6bc-2e16-4b8d-91e6-6ec58f134093 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:15.568752 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-bfffede9-7b65-4434-8865-8262cbd578b3 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:18:15.569171 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-bfffede9-7b65-4434-8865-8262cbd578b3 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:18:15.569636 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-bfffede9-7b65-4434-8865-8262cbd578b3 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:18:15.570040 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-bfffede9-7b65-4434-8865-8262cbd578b3 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:18:15.570446 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-bfffede9-7b65-4434-8865-8262cbd578b3 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:18:15.581904 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bfffede9-7b65-4434-8865-8262cbd578b3 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:15.582446 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bfffede9-7b65-4434-8865-8262cbd578b3 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:15.583189 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bfffede9-7b65-4434-8865-8262cbd578b3 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:15.583613 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bfffede9-7b65-4434-8865-8262cbd578b3 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:15.595419 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d1f4c6bc-2e16-4b8d-91e6-6ec58f134093 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.113172 Oct 28 12:18:15.596578 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 443/858] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:15 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:15.603462 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1886e4d9-8f7c-486f-a9e4-1b224088bc5c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:15.605748 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1886e4d9-8f7c-486f-a9e4-1b224088bc5c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:15.605900 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-bfffede9-7b65-4434-8865-8262cbd578b3 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Getting quotas for project 2307f41d09814947a921545ae8b32a1e. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:18:15.612564 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-bfffede9-7b65-4434-8865-8262cbd578b3 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Getting quotas for user 3d5416fdd41f47f88f05148c94b7af74 and project 2307f41d09814947a921545ae8b32a1e. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:18:15.612756 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1886e4d9-8f7c-486f-a9e4-1b224088bc5c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:15.613107 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1886e4d9-8f7c-486f-a9e4-1b224088bc5c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:15.614000 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1886e4d9-8f7c-486f-a9e4-1b224088bc5c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:15.614318 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1886e4d9-8f7c-486f-a9e4-1b224088bc5c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:15.626647 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bfffede9-7b65-4434-8865-8262cbd578b3 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:18:15.629357 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bfffede9-7b65-4434-8865-8262cbd578b3 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4385a199-a3e9-4c11-b580-60e7a24d0e97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:18:15.682404 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bfffede9-7b65-4434-8865-8262cbd578b3 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653246 Oct 28 12:18:15.683088 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 416/859] 10.222.0.37 () {60 vars in 1146 bytes} [Thu Oct 28 12:18:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 12:18:15.688208 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-191386ad-adb8-459a-b185-ee265cdf0dde tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:15.688975 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-191386ad-adb8-459a-b185-ee265cdf0dde tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:15.696200 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-191386ad-adb8-459a-b185-ee265cdf0dde tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:15.696813 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-191386ad-adb8-459a-b185-ee265cdf0dde tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:15.697935 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-191386ad-adb8-459a-b185-ee265cdf0dde tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:15.699435 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-191386ad-adb8-459a-b185-ee265cdf0dde tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:15.801823 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1886e4d9-8f7c-486f-a9e4-1b224088bc5c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:15.815780 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1886e4d9-8f7c-486f-a9e4-1b224088bc5c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.215621 Oct 28 12:18:15.816536 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 444/860] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:15 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:15.825671 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c91aa246-a881-43fd-aab4-e1be64c3f7c4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:15.825671 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c91aa246-a881-43fd-aab4-e1be64c3f7c4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:15.906102 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c91aa246-a881-43fd-aab4-e1be64c3f7c4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:15.909449 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-191386ad-adb8-459a-b185-ee265cdf0dde tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:15.913745 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c91aa246-a881-43fd-aab4-e1be64c3f7c4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1213 microversion: 2.1 time: 0.093392 Oct 28 12:18:15.914497 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 445/861] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:15 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:15.928792 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-191386ad-adb8-459a-b185-ee265cdf0dde tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:15.930459 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-191386ad-adb8-459a-b185-ee265cdf0dde tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:15.931768 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-191386ad-adb8-459a-b185-ee265cdf0dde tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1749 microversion: 2.20 time: 0.247468 Oct 28 12:18:15.932966 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 417/862] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:15 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1749 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:16.608445 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bd36c5cb-9da8-4d92-b558-fd9b3c662de7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:16.609761 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bd36c5cb-9da8-4d92-b558-fd9b3c662de7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:16.618188 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bd36c5cb-9da8-4d92-b558-fd9b3c662de7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:16.618636 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bd36c5cb-9da8-4d92-b558-fd9b3c662de7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:16.619823 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bd36c5cb-9da8-4d92-b558-fd9b3c662de7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:16.620265 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bd36c5cb-9da8-4d92-b558-fd9b3c662de7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:16.773569 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bd36c5cb-9da8-4d92-b558-fd9b3c662de7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.168954 Oct 28 12:18:16.774932 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 446/863] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:16 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:16.833036 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f987c21f-15bc-412e-875d-028813c06c76 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:16.833709 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f987c21f-15bc-412e-875d-028813c06c76 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:16.841021 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f987c21f-15bc-412e-875d-028813c06c76 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:16.841408 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f987c21f-15bc-412e-875d-028813c06c76 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:16.842169 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f987c21f-15bc-412e-875d-028813c06c76 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:16.842585 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f987c21f-15bc-412e-875d-028813c06c76 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:16.932235 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9bccaa7e-570a-4b67-a3b8-769a0caacf0a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:16.932943 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9bccaa7e-570a-4b67-a3b8-769a0caacf0a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:16.940588 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9bccaa7e-570a-4b67-a3b8-769a0caacf0a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:16.941036 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9bccaa7e-570a-4b67-a3b8-769a0caacf0a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:16.942094 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9bccaa7e-570a-4b67-a3b8-769a0caacf0a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:16.942739 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9bccaa7e-570a-4b67-a3b8-769a0caacf0a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:17.016781 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9bccaa7e-570a-4b67-a3b8-769a0caacf0a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:17.024926 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9bccaa7e-570a-4b67-a3b8-769a0caacf0a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1271 microversion: 2.1 time: 0.097022 Oct 28 12:18:17.025824 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 447/864] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:16 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:17.032799 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8dc020c7-85ad-4ca0-9a04-e82b43de2e8d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:17.033657 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8dc020c7-85ad-4ca0-9a04-e82b43de2e8d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:17.041056 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8dc020c7-85ad-4ca0-9a04-e82b43de2e8d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:17.041596 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8dc020c7-85ad-4ca0-9a04-e82b43de2e8d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:17.042448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8dc020c7-85ad-4ca0-9a04-e82b43de2e8d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:17.043094 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8dc020c7-85ad-4ca0-9a04-e82b43de2e8d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:17.054076 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f987c21f-15bc-412e-875d-028813c06c76 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:17.062264 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f987c21f-15bc-412e-875d-028813c06c76 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.232837 Oct 28 12:18:17.062857 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 418/865] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:16 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:17.174562 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8dc020c7-85ad-4ca0-9a04-e82b43de2e8d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:17.184429 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8dc020c7-85ad-4ca0-9a04-e82b43de2e8d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:17.186463 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8dc020c7-85ad-4ca0-9a04-e82b43de2e8d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:17.187771 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8dc020c7-85ad-4ca0-9a04-e82b43de2e8d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.160600 Oct 28 12:18:17.188492 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 448/866] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:17 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:17.497291 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-2ebed0b2-2423-4fe3-b8ad-e410647c6051 req-8126caf8-dee9-4b93-b33b-29527e70b96e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea6bc04f-095b-4b34-a107-3dbbd1d776fe", "name": "network-vif-plugged", "status": "completed", "tag": "cd823aea-fe57-404d-8292-19c6622c9992"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:17.500135 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:18:17.500135 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:18:17.509633 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-2ebed0b2-2423-4fe3-b8ad-e410647c6051 req-8126caf8-dee9-4b93-b33b-29527e70b96e service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:17.510272 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-2ebed0b2-2423-4fe3-b8ad-e410647c6051 req-8126caf8-dee9-4b93-b33b-29527e70b96e service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:17.521275 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-2ebed0b2-2423-4fe3-b8ad-e410647c6051 req-8126caf8-dee9-4b93-b33b-29527e70b96e service nova] Creating event network-vif-plugged:cd823aea-fe57-404d-8292-19c6622c9992 for instance ea6bc04f-095b-4b34-a107-3dbbd1d776fe on hv-cinder-81571 Oct 28 12:18:17.526921 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-2ebed0b2-2423-4fe3-b8ad-e410647c6051 req-8126caf8-dee9-4b93-b33b-29527e70b96e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032872 Oct 28 12:18:17.527670 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 419/867] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:18:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:18:17.786045 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7e5781a2-55e3-4378-bf19-8eadc9b61da5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:17.787041 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7e5781a2-55e3-4378-bf19-8eadc9b61da5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:17.793584 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7e5781a2-55e3-4378-bf19-8eadc9b61da5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:17.794035 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7e5781a2-55e3-4378-bf19-8eadc9b61da5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:17.795352 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7e5781a2-55e3-4378-bf19-8eadc9b61da5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:17.795829 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7e5781a2-55e3-4378-bf19-8eadc9b61da5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:17.856141 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7e5781a2-55e3-4378-bf19-8eadc9b61da5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28150 microversion: 2.1 time: 0.073504 Oct 28 12:18:17.856834 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 449/868] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:17 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28150 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:18.042061 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f78454d2-bd4f-44ec-8656-f72676b0dcca tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:18.042847 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f78454d2-bd4f-44ec-8656-f72676b0dcca tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:18.049556 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f78454d2-bd4f-44ec-8656-f72676b0dcca tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:18.049993 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f78454d2-bd4f-44ec-8656-f72676b0dcca tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:18.050775 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f78454d2-bd4f-44ec-8656-f72676b0dcca tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:18.051195 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f78454d2-bd4f-44ec-8656-f72676b0dcca tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:18.079881 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b2b64dd1-2e2e-4106-813d-340141b9a965 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:18.081361 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b2b64dd1-2e2e-4106-813d-340141b9a965 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:18.088634 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b2b64dd1-2e2e-4106-813d-340141b9a965 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:18.089149 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b2b64dd1-2e2e-4106-813d-340141b9a965 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:18.090017 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b2b64dd1-2e2e-4106-813d-340141b9a965 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:18.090505 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b2b64dd1-2e2e-4106-813d-340141b9a965 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:18.213195 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b2b64dd1-2e2e-4106-813d-340141b9a965 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:18.221146 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b2b64dd1-2e2e-4106-813d-340141b9a965 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.146037 Oct 28 12:18:18.221725 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 450/869] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:18 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:18.226079 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6c4122ea-c53c-4617-828f-790909721370 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:18.226976 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6c4122ea-c53c-4617-828f-790909721370 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:18.232907 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c4122ea-c53c-4617-828f-790909721370 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:18.233357 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c4122ea-c53c-4617-828f-790909721370 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:18.234139 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c4122ea-c53c-4617-828f-790909721370 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:18.234623 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c4122ea-c53c-4617-828f-790909721370 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:18.272678 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f78454d2-bd4f-44ec-8656-f72676b0dcca tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:18.286300 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f78454d2-bd4f-44ec-8656-f72676b0dcca tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.248603 Oct 28 12:18:18.287381 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 420/870] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:18 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:18.363379 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6c4122ea-c53c-4617-828f-790909721370 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:18.371991 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6c4122ea-c53c-4617-828f-790909721370 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:18.374038 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6c4122ea-c53c-4617-828f-790909721370 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:18.375318 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6c4122ea-c53c-4617-828f-790909721370 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.152684 Oct 28 12:18:18.375880 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 451/871] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:18 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:18.417035 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-5e632e92-edb8-439c-9b22-8b5578280bef req-ad123213-28d2-4a22-a0da-83de896291f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70", "tag": "e2879c41-a82f-4c20-b95f-6aac8fbff5d2"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:18.420630 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:18:18.420630 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:18:18.428541 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-5e632e92-edb8-439c-9b22-8b5578280bef req-ad123213-28d2-4a22-a0da-83de896291f8 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:18.428981 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-5e632e92-edb8-439c-9b22-8b5578280bef req-ad123213-28d2-4a22-a0da-83de896291f8 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:18.442507 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-5e632e92-edb8-439c-9b22-8b5578280bef req-ad123213-28d2-4a22-a0da-83de896291f8 service nova] Creating event network-changed:e2879c41-a82f-4c20-b95f-6aac8fbff5d2 for instance b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 on hv-cinder-81571 Oct 28 12:18:18.448142 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-5e632e92-edb8-439c-9b22-8b5578280bef req-ad123213-28d2-4a22-a0da-83de896291f8 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035591 Oct 28 12:18:18.448746 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 421/872] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:18:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:18:18.869928 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2fc11366-71c4-4ce1-ab07-a8305364bb92 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:18.874055 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2fc11366-71c4-4ce1-ab07-a8305364bb92 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:18.882038 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2fc11366-71c4-4ce1-ab07-a8305364bb92 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:18.883031 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2fc11366-71c4-4ce1-ab07-a8305364bb92 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:18.884416 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2fc11366-71c4-4ce1-ab07-a8305364bb92 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:18.885121 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2fc11366-71c4-4ce1-ab07-a8305364bb92 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:19.241940 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1e78c1d0-5689-43e6-ad5d-c0859d8f3b8f tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:19.242636 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1e78c1d0-5689-43e6-ad5d-c0859d8f3b8f tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:19.249420 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1e78c1d0-5689-43e6-ad5d-c0859d8f3b8f tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:19.250442 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1e78c1d0-5689-43e6-ad5d-c0859d8f3b8f tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:19.251424 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1e78c1d0-5689-43e6-ad5d-c0859d8f3b8f tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:19.252020 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1e78c1d0-5689-43e6-ad5d-c0859d8f3b8f tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:19.398159 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1e78c1d0-5689-43e6-ad5d-c0859d8f3b8f tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:19.406084 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1e78c1d0-5689-43e6-ad5d-c0859d8f3b8f tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.167576 Oct 28 12:18:19.406635 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 422/873] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:19 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:19.410733 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c54670da-7e03-4c6a-ab3f-794b2c77e5fd tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:19.411320 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c54670da-7e03-4c6a-ab3f-794b2c77e5fd tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:19.416651 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c54670da-7e03-4c6a-ab3f-794b2c77e5fd tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:19.417083 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c54670da-7e03-4c6a-ab3f-794b2c77e5fd tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:19.417828 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c54670da-7e03-4c6a-ab3f-794b2c77e5fd tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:19.418249 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c54670da-7e03-4c6a-ab3f-794b2c77e5fd tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:19.541742 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c54670da-7e03-4c6a-ab3f-794b2c77e5fd tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:19.549468 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c54670da-7e03-4c6a-ab3f-794b2c77e5fd tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.141846 Oct 28 12:18:19.550039 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 423/874] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:19 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:19.554764 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-70ee190b-966c-4ec5-aa04-83771eb441e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:19.555362 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-70ee190b-966c-4ec5-aa04-83771eb441e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:19.561694 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70ee190b-966c-4ec5-aa04-83771eb441e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:19.562133 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70ee190b-966c-4ec5-aa04-83771eb441e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:19.562918 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70ee190b-966c-4ec5-aa04-83771eb441e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:19.563345 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70ee190b-966c-4ec5-aa04-83771eb441e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:19.697935 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-70ee190b-966c-4ec5-aa04-83771eb441e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:19.708383 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-70ee190b-966c-4ec5-aa04-83771eb441e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:19.710266 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-70ee190b-966c-4ec5-aa04-83771eb441e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:19.711527 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-70ee190b-966c-4ec5-aa04-83771eb441e7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.160580 Oct 28 12:18:19.712184 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 424/875] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:19 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:20.422986 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-29378b4f-26c5-44c9-9a07-f9e526ee9668 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:20.423687 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-29378b4f-26c5-44c9-9a07-f9e526ee9668 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:20.432546 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29378b4f-26c5-44c9-9a07-f9e526ee9668 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:20.433250 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29378b4f-26c5-44c9-9a07-f9e526ee9668 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:20.434427 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29378b4f-26c5-44c9-9a07-f9e526ee9668 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:20.435047 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-29378b4f-26c5-44c9-9a07-f9e526ee9668 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:20.556078 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-29378b4f-26c5-44c9-9a07-f9e526ee9668 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:20.565643 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-29378b4f-26c5-44c9-9a07-f9e526ee9668 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.146632 Oct 28 12:18:20.575469 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 425/876] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:20 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:20.575469 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b2f0e326-1d97-4ba4-b5b8-0cae87f9b747 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:20.575469 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b2f0e326-1d97-4ba4-b5b8-0cae87f9b747 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:20.579469 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2f0e326-1d97-4ba4-b5b8-0cae87f9b747 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:20.579984 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2f0e326-1d97-4ba4-b5b8-0cae87f9b747 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:20.580832 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2f0e326-1d97-4ba4-b5b8-0cae87f9b747 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:20.581544 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2f0e326-1d97-4ba4-b5b8-0cae87f9b747 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:20.707811 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b2f0e326-1d97-4ba4-b5b8-0cae87f9b747 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:20.714950 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b2f0e326-1d97-4ba4-b5b8-0cae87f9b747 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.147736 Oct 28 12:18:20.715512 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 426/877] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:20 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:20.728822 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-123b5f17-578b-448c-8cd8-50a6eaecf991 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:20.729407 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-123b5f17-578b-448c-8cd8-50a6eaecf991 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:20.734943 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-123b5f17-578b-448c-8cd8-50a6eaecf991 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:20.735377 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-123b5f17-578b-448c-8cd8-50a6eaecf991 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:20.736122 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-123b5f17-578b-448c-8cd8-50a6eaecf991 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:20.736536 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-123b5f17-578b-448c-8cd8-50a6eaecf991 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:20.867888 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-123b5f17-578b-448c-8cd8-50a6eaecf991 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:20.876273 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-123b5f17-578b-448c-8cd8-50a6eaecf991 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:20.877834 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-123b5f17-578b-448c-8cd8-50a6eaecf991 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:20.879105 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-123b5f17-578b-448c-8cd8-50a6eaecf991 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.153793 Oct 28 12:18:20.879803 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 427/878] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:20 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:21.584983 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2f6fad05-0f7b-4a0b-84a9-c4786ab8c623 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:21.585800 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2f6fad05-0f7b-4a0b-84a9-c4786ab8c623 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:21.592286 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f6fad05-0f7b-4a0b-84a9-c4786ab8c623 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:21.592717 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f6fad05-0f7b-4a0b-84a9-c4786ab8c623 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:21.593481 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f6fad05-0f7b-4a0b-84a9-c4786ab8c623 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:21.593902 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f6fad05-0f7b-4a0b-84a9-c4786ab8c623 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:21.731674 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2f6fad05-0f7b-4a0b-84a9-c4786ab8c623 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:21.739625 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2f6fad05-0f7b-4a0b-84a9-c4786ab8c623 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.159723 Oct 28 12:18:21.740184 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 428/879] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:21 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:21.744276 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-09b39c5c-de16-43dd-9a8e-77571f2b9ba5 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:21.744857 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-09b39c5c-de16-43dd-9a8e-77571f2b9ba5 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:21.750218 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-09b39c5c-de16-43dd-9a8e-77571f2b9ba5 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:21.750659 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-09b39c5c-de16-43dd-9a8e-77571f2b9ba5 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:21.751429 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-09b39c5c-de16-43dd-9a8e-77571f2b9ba5 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:21.751847 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-09b39c5c-de16-43dd-9a8e-77571f2b9ba5 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:21.880128 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-09b39c5c-de16-43dd-9a8e-77571f2b9ba5 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:21.888044 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-09b39c5c-de16-43dd-9a8e-77571f2b9ba5 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.146858 Oct 28 12:18:21.888793 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 429/880] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:21 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:21.902097 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8edf98f5-c54a-4e28-9dec-ae672d0fe45a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:21.902707 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8edf98f5-c54a-4e28-9dec-ae672d0fe45a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:21.908985 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8edf98f5-c54a-4e28-9dec-ae672d0fe45a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:21.909419 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8edf98f5-c54a-4e28-9dec-ae672d0fe45a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:21.910168 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8edf98f5-c54a-4e28-9dec-ae672d0fe45a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:21.910588 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8edf98f5-c54a-4e28-9dec-ae672d0fe45a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:22.052962 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8edf98f5-c54a-4e28-9dec-ae672d0fe45a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:22.061037 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8edf98f5-c54a-4e28-9dec-ae672d0fe45a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:22.062545 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8edf98f5-c54a-4e28-9dec-ae672d0fe45a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:22.063710 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8edf98f5-c54a-4e28-9dec-ae672d0fe45a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.165263 Oct 28 12:18:22.064264 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 430/881] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:21 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:22.756201 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-698428ae-f758-49da-abb3-2a2fe7ef2ff8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:22.757088 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-698428ae-f758-49da-abb3-2a2fe7ef2ff8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:22.762973 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-698428ae-f758-49da-abb3-2a2fe7ef2ff8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:22.763588 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-698428ae-f758-49da-abb3-2a2fe7ef2ff8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:22.764847 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-698428ae-f758-49da-abb3-2a2fe7ef2ff8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:22.765277 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-698428ae-f758-49da-abb3-2a2fe7ef2ff8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:22.901791 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-698428ae-f758-49da-abb3-2a2fe7ef2ff8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:22.909266 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-698428ae-f758-49da-abb3-2a2fe7ef2ff8 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.156706 Oct 28 12:18:22.909828 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 431/882] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:22 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:22.914043 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-61531e95-e69a-49fa-99fd-f2e5a36fdf15 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:22.914632 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-61531e95-e69a-49fa-99fd-f2e5a36fdf15 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:22.920953 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-61531e95-e69a-49fa-99fd-f2e5a36fdf15 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:22.921388 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-61531e95-e69a-49fa-99fd-f2e5a36fdf15 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:22.922143 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-61531e95-e69a-49fa-99fd-f2e5a36fdf15 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:22.922566 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-61531e95-e69a-49fa-99fd-f2e5a36fdf15 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:23.052828 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-61531e95-e69a-49fa-99fd-f2e5a36fdf15 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:23.061947 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-61531e95-e69a-49fa-99fd-f2e5a36fdf15 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.151007 Oct 28 12:18:23.063055 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 432/883] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:22 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:23.081302 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-67f8c4fb-0f0d-4a66-9e5a-0e3f6836f12a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:23.081890 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-67f8c4fb-0f0d-4a66-9e5a-0e3f6836f12a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:23.087744 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-67f8c4fb-0f0d-4a66-9e5a-0e3f6836f12a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:23.088182 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-67f8c4fb-0f0d-4a66-9e5a-0e3f6836f12a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:23.088936 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-67f8c4fb-0f0d-4a66-9e5a-0e3f6836f12a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:23.089363 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-67f8c4fb-0f0d-4a66-9e5a-0e3f6836f12a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:23.224773 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-67f8c4fb-0f0d-4a66-9e5a-0e3f6836f12a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:23.232952 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-67f8c4fb-0f0d-4a66-9e5a-0e3f6836f12a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:23.235142 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-67f8c4fb-0f0d-4a66-9e5a-0e3f6836f12a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:23.236286 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-67f8c4fb-0f0d-4a66-9e5a-0e3f6836f12a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.158449 Oct 28 12:18:23.236838 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 433/884] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:23 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:23.926617 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-63d2e2a9-711b-4b6b-8178-0db27dfc9a4d tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:23.927317 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-63d2e2a9-711b-4b6b-8178-0db27dfc9a4d tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:23.933516 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63d2e2a9-711b-4b6b-8178-0db27dfc9a4d tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:23.933961 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63d2e2a9-711b-4b6b-8178-0db27dfc9a4d tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:23.934752 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63d2e2a9-711b-4b6b-8178-0db27dfc9a4d tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:23.935184 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63d2e2a9-711b-4b6b-8178-0db27dfc9a4d tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:24.059001 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-63d2e2a9-711b-4b6b-8178-0db27dfc9a4d tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:24.067813 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-63d2e2a9-711b-4b6b-8178-0db27dfc9a4d tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.144773 Oct 28 12:18:24.068460 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 434/885] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:23 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:24.079100 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6758cf70-bd53-4512-861f-5536aca6ca03 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:24.079699 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6758cf70-bd53-4512-861f-5536aca6ca03 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:24.085440 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6758cf70-bd53-4512-861f-5536aca6ca03 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:24.085891 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6758cf70-bd53-4512-861f-5536aca6ca03 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:24.086657 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6758cf70-bd53-4512-861f-5536aca6ca03 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:24.087108 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6758cf70-bd53-4512-861f-5536aca6ca03 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:24.207765 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6758cf70-bd53-4512-861f-5536aca6ca03 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:24.215173 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6758cf70-bd53-4512-861f-5536aca6ca03 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.139996 Oct 28 12:18:24.215750 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 435/886] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:24 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:24.253691 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f4b743c2-c803-40ec-a3ba-1de93dca1205 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:24.254284 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f4b743c2-c803-40ec-a3ba-1de93dca1205 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:24.260358 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f4b743c2-c803-40ec-a3ba-1de93dca1205 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:24.260799 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f4b743c2-c803-40ec-a3ba-1de93dca1205 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:24.261552 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f4b743c2-c803-40ec-a3ba-1de93dca1205 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:24.261978 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f4b743c2-c803-40ec-a3ba-1de93dca1205 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:24.393758 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f4b743c2-c803-40ec-a3ba-1de93dca1205 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:24.401850 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f4b743c2-c803-40ec-a3ba-1de93dca1205 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:24.403370 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f4b743c2-c803-40ec-a3ba-1de93dca1205 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:24.404513 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f4b743c2-c803-40ec-a3ba-1de93dca1205 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.155055 Oct 28 12:18:24.405072 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 436/887] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:24 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:25.086392 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fcd1c705-b2bf-44a1-a833-bb9947a8f346 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:25.087571 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fcd1c705-b2bf-44a1-a833-bb9947a8f346 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:25.094479 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fcd1c705-b2bf-44a1-a833-bb9947a8f346 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:25.095094 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fcd1c705-b2bf-44a1-a833-bb9947a8f346 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:25.095982 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fcd1c705-b2bf-44a1-a833-bb9947a8f346 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:25.096521 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fcd1c705-b2bf-44a1-a833-bb9947a8f346 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:25.220402 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fcd1c705-b2bf-44a1-a833-bb9947a8f346 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:25.233104 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fcd1c705-b2bf-44a1-a833-bb9947a8f346 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.150351 Oct 28 12:18:25.234198 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 437/888] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:25 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:25.239890 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-31c43ffe-9cc0-4e82-8c95-4e91ba617849 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:25.240489 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-31c43ffe-9cc0-4e82-8c95-4e91ba617849 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:25.247019 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-31c43ffe-9cc0-4e82-8c95-4e91ba617849 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:25.247467 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-31c43ffe-9cc0-4e82-8c95-4e91ba617849 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:25.248293 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-31c43ffe-9cc0-4e82-8c95-4e91ba617849 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:25.248675 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-31c43ffe-9cc0-4e82-8c95-4e91ba617849 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:25.369731 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-31c43ffe-9cc0-4e82-8c95-4e91ba617849 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:25.377102 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-31c43ffe-9cc0-4e82-8c95-4e91ba617849 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.140560 Oct 28 12:18:25.377708 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 438/889] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:25 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:25.422837 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1c8482e8-84b0-47bd-804a-a8b082ef8c73 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:25.423444 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1c8482e8-84b0-47bd-804a-a8b082ef8c73 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:25.429380 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c8482e8-84b0-47bd-804a-a8b082ef8c73 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:25.429765 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c8482e8-84b0-47bd-804a-a8b082ef8c73 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:25.430533 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c8482e8-84b0-47bd-804a-a8b082ef8c73 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:25.431000 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1c8482e8-84b0-47bd-804a-a8b082ef8c73 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:25.555657 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1c8482e8-84b0-47bd-804a-a8b082ef8c73 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:25.567214 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1c8482e8-84b0-47bd-804a-a8b082ef8c73 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:25.568688 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1c8482e8-84b0-47bd-804a-a8b082ef8c73 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:25.569829 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1c8482e8-84b0-47bd-804a-a8b082ef8c73 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.150984 Oct 28 12:18:25.570381 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 439/890] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:25 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:26.250000 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9d34c976-f614-40ba-b966-07f79b88d427 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:26.250732 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9d34c976-f614-40ba-b966-07f79b88d427 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:26.256809 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d34c976-f614-40ba-b966-07f79b88d427 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:26.257251 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d34c976-f614-40ba-b966-07f79b88d427 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:26.258010 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d34c976-f614-40ba-b966-07f79b88d427 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:26.258436 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d34c976-f614-40ba-b966-07f79b88d427 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:26.383872 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9d34c976-f614-40ba-b966-07f79b88d427 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:26.390980 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9d34c976-f614-40ba-b966-07f79b88d427 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.144532 Oct 28 12:18:26.391538 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 440/891] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:26 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:26.395791 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bee2f215-13e8-4c77-974a-141f02e91023 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:26.396380 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bee2f215-13e8-4c77-974a-141f02e91023 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:26.402242 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bee2f215-13e8-4c77-974a-141f02e91023 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:26.402704 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bee2f215-13e8-4c77-974a-141f02e91023 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:26.403511 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bee2f215-13e8-4c77-974a-141f02e91023 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:26.404009 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bee2f215-13e8-4c77-974a-141f02e91023 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:26.534608 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-bee2f215-13e8-4c77-974a-141f02e91023 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:26.541879 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bee2f215-13e8-4c77-974a-141f02e91023 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.149314 Oct 28 12:18:26.542437 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 441/892] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:26 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:26.591885 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-543a85f4-33a4-4b1b-a1ae-8cb94aa69ba8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:26.592480 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-543a85f4-33a4-4b1b-a1ae-8cb94aa69ba8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:26.599659 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-543a85f4-33a4-4b1b-a1ae-8cb94aa69ba8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:26.600176 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-543a85f4-33a4-4b1b-a1ae-8cb94aa69ba8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:26.601029 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-543a85f4-33a4-4b1b-a1ae-8cb94aa69ba8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:26.601441 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-543a85f4-33a4-4b1b-a1ae-8cb94aa69ba8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:26.726366 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-543a85f4-33a4-4b1b-a1ae-8cb94aa69ba8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:26.734604 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-543a85f4-33a4-4b1b-a1ae-8cb94aa69ba8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:26.736104 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-543a85f4-33a4-4b1b-a1ae-8cb94aa69ba8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:26.737240 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-543a85f4-33a4-4b1b-a1ae-8cb94aa69ba8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.149500 Oct 28 12:18:26.737794 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 442/893] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:26 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:27.407923 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-09940010-39ca-455b-b029-7db3ed1dc772 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:27.408624 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-09940010-39ca-455b-b029-7db3ed1dc772 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:27.414914 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-09940010-39ca-455b-b029-7db3ed1dc772 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:27.415427 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-09940010-39ca-455b-b029-7db3ed1dc772 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:27.416267 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-09940010-39ca-455b-b029-7db3ed1dc772 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:27.416782 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-09940010-39ca-455b-b029-7db3ed1dc772 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:27.540074 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-09940010-39ca-455b-b029-7db3ed1dc772 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:27.548590 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-09940010-39ca-455b-b029-7db3ed1dc772 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.144377 Oct 28 12:18:27.549165 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 443/894] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:27 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:27.558982 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5911c1d0-eead-492b-b62d-a4e15b0f3875 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:27.559895 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5911c1d0-eead-492b-b62d-a4e15b0f3875 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:27.566477 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5911c1d0-eead-492b-b62d-a4e15b0f3875 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:27.566950 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5911c1d0-eead-492b-b62d-a4e15b0f3875 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:27.567703 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5911c1d0-eead-492b-b62d-a4e15b0f3875 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:27.568123 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5911c1d0-eead-492b-b62d-a4e15b0f3875 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:27.698729 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5911c1d0-eead-492b-b62d-a4e15b0f3875 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:27.706491 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5911c1d0-eead-492b-b62d-a4e15b0f3875 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.151149 Oct 28 12:18:27.707097 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 444/895] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:27 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:27.754735 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ebce0520-14ad-4d43-b7f1-c02b49515711 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:27.755334 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ebce0520-14ad-4d43-b7f1-c02b49515711 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:27.761298 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ebce0520-14ad-4d43-b7f1-c02b49515711 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:27.761737 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ebce0520-14ad-4d43-b7f1-c02b49515711 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:27.762495 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ebce0520-14ad-4d43-b7f1-c02b49515711 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:27.762969 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ebce0520-14ad-4d43-b7f1-c02b49515711 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:27.891974 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ebce0520-14ad-4d43-b7f1-c02b49515711 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:27.900221 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ebce0520-14ad-4d43-b7f1-c02b49515711 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:27.901669 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ebce0520-14ad-4d43-b7f1-c02b49515711 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:27.902857 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ebce0520-14ad-4d43-b7f1-c02b49515711 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.151893 Oct 28 12:18:27.903610 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 445/896] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:27 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:28.567274 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-513922dd-ef57-4f90-bad0-330877ac1bb1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:28.567877 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-513922dd-ef57-4f90-bad0-330877ac1bb1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:28.574110 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-513922dd-ef57-4f90-bad0-330877ac1bb1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:28.574583 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-513922dd-ef57-4f90-bad0-330877ac1bb1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:28.575378 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-513922dd-ef57-4f90-bad0-330877ac1bb1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:28.575810 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-513922dd-ef57-4f90-bad0-330877ac1bb1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:28.703956 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-513922dd-ef57-4f90-bad0-330877ac1bb1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:28.711076 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-513922dd-ef57-4f90-bad0-330877ac1bb1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.147442 Oct 28 12:18:28.711642 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 446/897] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:28 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:28.722109 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8044e4f7-5a75-49ce-9017-141b1bbe628d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:28.722727 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8044e4f7-5a75-49ce-9017-141b1bbe628d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:28.729184 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8044e4f7-5a75-49ce-9017-141b1bbe628d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:28.729757 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8044e4f7-5a75-49ce-9017-141b1bbe628d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:28.730613 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8044e4f7-5a75-49ce-9017-141b1bbe628d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:28.731195 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8044e4f7-5a75-49ce-9017-141b1bbe628d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:28.869102 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8044e4f7-5a75-49ce-9017-141b1bbe628d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:28.877192 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8044e4f7-5a75-49ce-9017-141b1bbe628d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.158547 Oct 28 12:18:28.877763 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 447/898] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:28 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:28.924040 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0b8ddea4-ccec-4f0f-9dff-316603e1479a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:28.924640 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0b8ddea4-ccec-4f0f-9dff-316603e1479a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:28.931010 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0b8ddea4-ccec-4f0f-9dff-316603e1479a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:28.931453 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0b8ddea4-ccec-4f0f-9dff-316603e1479a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:28.932234 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0b8ddea4-ccec-4f0f-9dff-316603e1479a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:28.932668 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0b8ddea4-ccec-4f0f-9dff-316603e1479a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:29.057601 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0b8ddea4-ccec-4f0f-9dff-316603e1479a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:29.067439 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0b8ddea4-ccec-4f0f-9dff-316603e1479a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:29.069046 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0b8ddea4-ccec-4f0f-9dff-316603e1479a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:29.071287 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0b8ddea4-ccec-4f0f-9dff-316603e1479a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.153425 Oct 28 12:18:29.072184 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 448/899] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:28 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:29.728375 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7e973190-559e-4b6f-b873-a0c06e91d926 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:29.729470 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7e973190-559e-4b6f-b873-a0c06e91d926 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:29.739927 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7e973190-559e-4b6f-b873-a0c06e91d926 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:29.740379 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7e973190-559e-4b6f-b873-a0c06e91d926 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:29.741164 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7e973190-559e-4b6f-b873-a0c06e91d926 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:29.741713 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7e973190-559e-4b6f-b873-a0c06e91d926 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:29.871231 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7e973190-559e-4b6f-b873-a0c06e91d926 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:29.878511 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7e973190-559e-4b6f-b873-a0c06e91d926 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.154039 Oct 28 12:18:29.879108 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 449/900] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:29 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:29.893998 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c3c99d5f-0758-4dc0-9c08-444a2d46c08d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:29.894596 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c3c99d5f-0758-4dc0-9c08-444a2d46c08d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:29.900270 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3c99d5f-0758-4dc0-9c08-444a2d46c08d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:29.900708 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3c99d5f-0758-4dc0-9c08-444a2d46c08d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:29.901465 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3c99d5f-0758-4dc0-9c08-444a2d46c08d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:29.901893 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c3c99d5f-0758-4dc0-9c08-444a2d46c08d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:30.029013 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c3c99d5f-0758-4dc0-9c08-444a2d46c08d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:30.036354 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c3c99d5f-0758-4dc0-9c08-444a2d46c08d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.145769 Oct 28 12:18:30.036930 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 450/901] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:29 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:30.089133 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a10b7199-fbbf-47cb-a68f-965a2d26c27a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:30.089755 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a10b7199-fbbf-47cb-a68f-965a2d26c27a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:30.095606 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a10b7199-fbbf-47cb-a68f-965a2d26c27a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:30.096041 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a10b7199-fbbf-47cb-a68f-965a2d26c27a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:30.096790 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a10b7199-fbbf-47cb-a68f-965a2d26c27a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:30.097212 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a10b7199-fbbf-47cb-a68f-965a2d26c27a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:30.225643 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a10b7199-fbbf-47cb-a68f-965a2d26c27a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:30.234593 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a10b7199-fbbf-47cb-a68f-965a2d26c27a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:30.236239 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a10b7199-fbbf-47cb-a68f-965a2d26c27a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:30.237473 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a10b7199-fbbf-47cb-a68f-965a2d26c27a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.152023 Oct 28 12:18:30.238158 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 451/902] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:30 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:30.895842 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-273879d4-fb53-4a30-8412-cd2effe9681c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:30.896563 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-273879d4-fb53-4a30-8412-cd2effe9681c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:30.903144 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-273879d4-fb53-4a30-8412-cd2effe9681c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:30.903700 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-273879d4-fb53-4a30-8412-cd2effe9681c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:30.904547 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-273879d4-fb53-4a30-8412-cd2effe9681c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:30.905050 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-273879d4-fb53-4a30-8412-cd2effe9681c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:31.026531 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-273879d4-fb53-4a30-8412-cd2effe9681c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:31.033784 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-273879d4-fb53-4a30-8412-cd2effe9681c tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.141737 Oct 28 12:18:31.034349 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 452/903] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:30 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:31.052881 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-63b10854-b956-4e74-b192-e68c3c81dfb4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:31.053606 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-63b10854-b956-4e74-b192-e68c3c81dfb4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:31.063304 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63b10854-b956-4e74-b192-e68c3c81dfb4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:31.064530 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63b10854-b956-4e74-b192-e68c3c81dfb4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:31.065477 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63b10854-b956-4e74-b192-e68c3c81dfb4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:31.067801 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63b10854-b956-4e74-b192-e68c3c81dfb4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:31.199773 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-63b10854-b956-4e74-b192-e68c3c81dfb4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:31.206975 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-63b10854-b956-4e74-b192-e68c3c81dfb4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.157766 Oct 28 12:18:31.207545 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 453/904] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:31 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:31.256403 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-08b0f770-d169-49f8-b099-23aba1a41e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:31.256993 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-08b0f770-d169-49f8-b099-23aba1a41e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:31.263743 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08b0f770-d169-49f8-b099-23aba1a41e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:31.264182 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08b0f770-d169-49f8-b099-23aba1a41e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:31.265126 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08b0f770-d169-49f8-b099-23aba1a41e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:31.265551 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-08b0f770-d169-49f8-b099-23aba1a41e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:31.391704 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-08b0f770-d169-49f8-b099-23aba1a41e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:31.399944 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-08b0f770-d169-49f8-b099-23aba1a41e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:31.401461 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-08b0f770-d169-49f8-b099-23aba1a41e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:31.402614 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-08b0f770-d169-49f8-b099-23aba1a41e37 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.150144 Oct 28 12:18:31.403209 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 454/905] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:31 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:32.051041 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-96727559-e3c5-490e-b614-776cbb668381 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:32.051741 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-96727559-e3c5-490e-b614-776cbb668381 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:32.057886 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-96727559-e3c5-490e-b614-776cbb668381 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:32.058326 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-96727559-e3c5-490e-b614-776cbb668381 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:32.059116 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-96727559-e3c5-490e-b614-776cbb668381 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:32.059542 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-96727559-e3c5-490e-b614-776cbb668381 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:32.180322 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-96727559-e3c5-490e-b614-776cbb668381 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:32.187445 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-96727559-e3c5-490e-b614-776cbb668381 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.140038 Oct 28 12:18:32.188003 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 455/906] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:32 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:32.223467 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2eed4bd3-91f4-4d81-9960-95282d0c77bd tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:32.224060 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2eed4bd3-91f4-4d81-9960-95282d0c77bd tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:32.229641 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2eed4bd3-91f4-4d81-9960-95282d0c77bd tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:32.230087 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2eed4bd3-91f4-4d81-9960-95282d0c77bd tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:32.230894 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2eed4bd3-91f4-4d81-9960-95282d0c77bd tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:32.231328 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2eed4bd3-91f4-4d81-9960-95282d0c77bd tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:32.349675 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2eed4bd3-91f4-4d81-9960-95282d0c77bd tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:32.356791 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2eed4bd3-91f4-4d81-9960-95282d0c77bd tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.136778 Oct 28 12:18:32.357347 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 456/907] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:32 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:32.421987 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-85bbd1fa-4a14-43e1-b42b-ac27a2176633 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:32.422503 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-85bbd1fa-4a14-43e1-b42b-ac27a2176633 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:32.428376 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-85bbd1fa-4a14-43e1-b42b-ac27a2176633 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:32.428822 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-85bbd1fa-4a14-43e1-b42b-ac27a2176633 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:32.429589 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-85bbd1fa-4a14-43e1-b42b-ac27a2176633 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:32.430020 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-85bbd1fa-4a14-43e1-b42b-ac27a2176633 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:32.553777 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-85bbd1fa-4a14-43e1-b42b-ac27a2176633 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:32.561810 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-85bbd1fa-4a14-43e1-b42b-ac27a2176633 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:32.563316 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-85bbd1fa-4a14-43e1-b42b-ac27a2176633 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:32.564441 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-85bbd1fa-4a14-43e1-b42b-ac27a2176633 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.147105 Oct 28 12:18:32.564986 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 457/908] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:32 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:33.204735 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-51a19942-737d-4e13-991a-575469a4fbf4 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:33.205391 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-51a19942-737d-4e13-991a-575469a4fbf4 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:33.211582 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-51a19942-737d-4e13-991a-575469a4fbf4 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:33.212022 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-51a19942-737d-4e13-991a-575469a4fbf4 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:33.212778 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-51a19942-737d-4e13-991a-575469a4fbf4 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:33.213204 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-51a19942-737d-4e13-991a-575469a4fbf4 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:33.331465 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-51a19942-737d-4e13-991a-575469a4fbf4 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:33.338584 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-51a19942-737d-4e13-991a-575469a4fbf4 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.138182 Oct 28 12:18:33.339183 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 458/909] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:33 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:33.372618 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fa238eb4-c5f3-41c0-97f5-c205076a287a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:33.373214 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fa238eb4-c5f3-41c0-97f5-c205076a287a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:33.379415 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fa238eb4-c5f3-41c0-97f5-c205076a287a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:33.379857 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fa238eb4-c5f3-41c0-97f5-c205076a287a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:33.380611 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fa238eb4-c5f3-41c0-97f5-c205076a287a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:33.381037 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fa238eb4-c5f3-41c0-97f5-c205076a287a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:33.497355 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fa238eb4-c5f3-41c0-97f5-c205076a287a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:33.505243 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fa238eb4-c5f3-41c0-97f5-c205076a287a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.135984 Oct 28 12:18:33.505918 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 459/910] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:33 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:33.581985 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7651a7af-2fee-45a5-b1af-36cbf1531f55 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:33.582580 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7651a7af-2fee-45a5-b1af-36cbf1531f55 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:33.588236 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7651a7af-2fee-45a5-b1af-36cbf1531f55 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:33.588681 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7651a7af-2fee-45a5-b1af-36cbf1531f55 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:33.589442 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7651a7af-2fee-45a5-b1af-36cbf1531f55 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:33.589870 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7651a7af-2fee-45a5-b1af-36cbf1531f55 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:33.710855 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7651a7af-2fee-45a5-b1af-36cbf1531f55 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:33.719524 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7651a7af-2fee-45a5-b1af-36cbf1531f55 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:33.721002 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7651a7af-2fee-45a5-b1af-36cbf1531f55 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:33.722140 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7651a7af-2fee-45a5-b1af-36cbf1531f55 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.143619 Oct 28 12:18:33.722731 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 460/911] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:33 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:34.355127 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-47a194b5-7934-41e0-ac32-fa8c130354e1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:34.355783 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-47a194b5-7934-41e0-ac32-fa8c130354e1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:34.361910 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47a194b5-7934-41e0-ac32-fa8c130354e1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:34.362360 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47a194b5-7934-41e0-ac32-fa8c130354e1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:34.363165 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47a194b5-7934-41e0-ac32-fa8c130354e1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:34.363594 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47a194b5-7934-41e0-ac32-fa8c130354e1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:34.445918 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2fc11366-71c4-4ce1-ab07-a8305364bb92 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 15.580731 Oct 28 12:18:34.446826 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 452/912] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:18 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 15583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:34.522311 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b3fb75e3-6252-4375-b97b-9c88e752dc63 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:34.523011 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b3fb75e3-6252-4375-b97b-9c88e752dc63 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:34.530027 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3fb75e3-6252-4375-b97b-9c88e752dc63 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:34.530570 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3fb75e3-6252-4375-b97b-9c88e752dc63 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:34.531922 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3fb75e3-6252-4375-b97b-9c88e752dc63 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:34.532652 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3fb75e3-6252-4375-b97b-9c88e752dc63 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:34.667979 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b3fb75e3-6252-4375-b97b-9c88e752dc63 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:34.676482 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b3fb75e3-6252-4375-b97b-9c88e752dc63 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.158206 Oct 28 12:18:34.677062 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 453/913] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:34 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:34.740277 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-caec48a4-6670-4714-aeaf-36d378567895 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:34.740891 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-caec48a4-6670-4714-aeaf-36d378567895 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:34.747100 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-caec48a4-6670-4714-aeaf-36d378567895 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:34.747610 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-caec48a4-6670-4714-aeaf-36d378567895 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:34.748398 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-caec48a4-6670-4714-aeaf-36d378567895 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:34.749339 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-caec48a4-6670-4714-aeaf-36d378567895 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:34.799370 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-47a194b5-7934-41e0-ac32-fa8c130354e1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:34.808064 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-47a194b5-7934-41e0-ac32-fa8c130354e1 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1318 microversion: 2.1 time: 0.456496 Oct 28 12:18:34.808770 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 461/914] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:34 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:34.882862 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-caec48a4-6670-4714-aeaf-36d378567895 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:34.891507 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-caec48a4-6670-4714-aeaf-36d378567895 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:34.892987 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-caec48a4-6670-4714-aeaf-36d378567895 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:34.894138 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-caec48a4-6670-4714-aeaf-36d378567895 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.157682 Oct 28 12:18:34.894723 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 454/915] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:34 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:35.457486 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-79c41c2d-c774-4a9f-ba34-c1b13a99e4f3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:35.458476 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-79c41c2d-c774-4a9f-ba34-c1b13a99e4f3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:35.465362 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-79c41c2d-c774-4a9f-ba34-c1b13a99e4f3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:35.465883 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-79c41c2d-c774-4a9f-ba34-c1b13a99e4f3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:35.466915 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-79c41c2d-c774-4a9f-ba34-c1b13a99e4f3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:35.467416 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-79c41c2d-c774-4a9f-ba34-c1b13a99e4f3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:35.622605 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-79c41c2d-c774-4a9f-ba34-c1b13a99e4f3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.168517 Oct 28 12:18:35.623424 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 462/916] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:35 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:35.693043 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7f83035e-1767-4300-a964-d74dd0639835 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:35.693649 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7f83035e-1767-4300-a964-d74dd0639835 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:35.699874 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7f83035e-1767-4300-a964-d74dd0639835 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:35.700318 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7f83035e-1767-4300-a964-d74dd0639835 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:35.701085 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7f83035e-1767-4300-a964-d74dd0639835 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:35.701517 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7f83035e-1767-4300-a964-d74dd0639835 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:35.818942 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7f83035e-1767-4300-a964-d74dd0639835 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:35.826297 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7d8936f7-148a-44e6-9989-9e3bfd34d474 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:35.826527 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7f83035e-1767-4300-a964-d74dd0639835 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.137066 Oct 28 12:18:35.827048 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7d8936f7-148a-44e6-9989-9e3bfd34d474 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:35.827190 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 455/917] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:35 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:35.834033 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d8936f7-148a-44e6-9989-9e3bfd34d474 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:35.834466 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d8936f7-148a-44e6-9989-9e3bfd34d474 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:35.835342 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d8936f7-148a-44e6-9989-9e3bfd34d474 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:35.835768 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d8936f7-148a-44e6-9989-9e3bfd34d474 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:35.911978 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-27e8f9bc-3adf-438f-8490-4fe2ef80a070 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:35.912581 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-27e8f9bc-3adf-438f-8490-4fe2ef80a070 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:35.918377 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-27e8f9bc-3adf-438f-8490-4fe2ef80a070 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:35.918863 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-27e8f9bc-3adf-438f-8490-4fe2ef80a070 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:35.919662 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-27e8f9bc-3adf-438f-8490-4fe2ef80a070 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:35.920309 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-27e8f9bc-3adf-438f-8490-4fe2ef80a070 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:35.962188 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7d8936f7-148a-44e6-9989-9e3bfd34d474 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:35.969973 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7d8936f7-148a-44e6-9989-9e3bfd34d474 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1507 microversion: 2.1 time: 0.148363 Oct 28 12:18:35.970536 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 463/918] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:35 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:35.986060 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-154c3b61-cf3b-47d8-8a67-b3b5c7e2224e tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab8eb6d4-2821-40b2-bc94-4da3ba7ecb9b", "device": "/dev/sdb"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:35.987862 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-154c3b61-cf3b-47d8-8a67-b3b5c7e2224e tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:35.996233 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-154c3b61-cf3b-47d8-8a67-b3b5c7e2224e tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:35.996768 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-154c3b61-cf3b-47d8-8a67-b3b5c7e2224e tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:35.997661 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-154c3b61-cf3b-47d8-8a67-b3b5c7e2224e tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:35.998160 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-154c3b61-cf3b-47d8-8a67-b3b5c7e2224e tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:36.045675 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-27e8f9bc-3adf-438f-8490-4fe2ef80a070 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:36.054164 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-27e8f9bc-3adf-438f-8490-4fe2ef80a070 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:36.055683 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-27e8f9bc-3adf-438f-8490-4fe2ef80a070 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:36.056838 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-27e8f9bc-3adf-438f-8490-4fe2ef80a070 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.148566 Oct 28 12:18:36.057402 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 456/919] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:35 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:36.228932 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-154c3b61-cf3b-47d8-8a67-b3b5c7e2224e tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "POST /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246520 Oct 28 12:18:36.229535 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 464/920] 10.222.0.37 () {60 vars in 1322 bytes} [Thu Oct 28 12:18:35 2021] POST /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:18:36.633273 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-33ece785-7986-4846-a2e7-a266b02b9dc9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:36.634223 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-33ece785-7986-4846-a2e7-a266b02b9dc9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:36.640894 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-33ece785-7986-4846-a2e7-a266b02b9dc9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:36.641328 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-33ece785-7986-4846-a2e7-a266b02b9dc9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:36.642080 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-33ece785-7986-4846-a2e7-a266b02b9dc9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:36.642501 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-33ece785-7986-4846-a2e7-a266b02b9dc9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:36.812067 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-33ece785-7986-4846-a2e7-a266b02b9dc9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.182185 Oct 28 12:18:36.813199 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 457/921] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:36 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:36.844299 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cda78da9-ff6e-48d6-89b5-6f046390206d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:36.844994 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cda78da9-ff6e-48d6-89b5-6f046390206d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:36.851072 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cda78da9-ff6e-48d6-89b5-6f046390206d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:36.851513 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cda78da9-ff6e-48d6-89b5-6f046390206d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:36.852278 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cda78da9-ff6e-48d6-89b5-6f046390206d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:36.852708 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cda78da9-ff6e-48d6-89b5-6f046390206d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:36.974452 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-cda78da9-ff6e-48d6-89b5-6f046390206d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:36.981853 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cda78da9-ff6e-48d6-89b5-6f046390206d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.142005 Oct 28 12:18:36.982426 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 465/922] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:36 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:37.076995 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-81116d97-5aba-4f98-a04c-d500207ec826 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:37.077579 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-81116d97-5aba-4f98-a04c-d500207ec826 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:37.085494 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-81116d97-5aba-4f98-a04c-d500207ec826 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:37.085945 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-81116d97-5aba-4f98-a04c-d500207ec826 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:37.086754 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-81116d97-5aba-4f98-a04c-d500207ec826 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:37.087189 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-81116d97-5aba-4f98-a04c-d500207ec826 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:37.210223 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-81116d97-5aba-4f98-a04c-d500207ec826 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:37.219490 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-81116d97-5aba-4f98-a04c-d500207ec826 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:37.221112 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-81116d97-5aba-4f98-a04c-d500207ec826 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:37.222275 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-81116d97-5aba-4f98-a04c-d500207ec826 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.149463 Oct 28 12:18:37.222869 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 458/923] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:37 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:37.823980 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b9875628-5393-4316-9923-bbaf5df7fb18 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:37.824941 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b9875628-5393-4316-9923-bbaf5df7fb18 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:37.831881 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b9875628-5393-4316-9923-bbaf5df7fb18 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:37.832330 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b9875628-5393-4316-9923-bbaf5df7fb18 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:37.833095 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b9875628-5393-4316-9923-bbaf5df7fb18 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:37.833522 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b9875628-5393-4316-9923-bbaf5df7fb18 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:37.894894 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b9875628-5393-4316-9923-bbaf5df7fb18 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.074339 Oct 28 12:18:37.895866 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 466/924] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:37 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:37.998787 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8d5d3d1b-8ef5-4ed2-9083-4908cebc10a0 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:37.999395 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8d5d3d1b-8ef5-4ed2-9083-4908cebc10a0 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:38.006260 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d5d3d1b-8ef5-4ed2-9083-4908cebc10a0 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:38.006728 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d5d3d1b-8ef5-4ed2-9083-4908cebc10a0 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:38.007502 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d5d3d1b-8ef5-4ed2-9083-4908cebc10a0 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:38.007932 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8d5d3d1b-8ef5-4ed2-9083-4908cebc10a0 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:38.126116 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8d5d3d1b-8ef5-4ed2-9083-4908cebc10a0 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:38.133279 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8d5d3d1b-8ef5-4ed2-9083-4908cebc10a0 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.138187 Oct 28 12:18:38.133851 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 459/925] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:37 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:38.241465 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-03fe069b-be68-41ec-8a5b-4602041c032e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:38.242172 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-03fe069b-be68-41ec-8a5b-4602041c032e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:38.248872 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-03fe069b-be68-41ec-8a5b-4602041c032e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:38.249308 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-03fe069b-be68-41ec-8a5b-4602041c032e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:38.250061 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-03fe069b-be68-41ec-8a5b-4602041c032e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:38.250488 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-03fe069b-be68-41ec-8a5b-4602041c032e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:38.372184 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-03fe069b-be68-41ec-8a5b-4602041c032e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:38.381018 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-03fe069b-be68-41ec-8a5b-4602041c032e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:38.382504 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-03fe069b-be68-41ec-8a5b-4602041c032e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:38.383690 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-03fe069b-be68-41ec-8a5b-4602041c032e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.146242 Oct 28 12:18:38.384263 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 467/926] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:38 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:38.906845 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-96c19389-871f-494f-ad8f-7c1e5f6eba5d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:38.907319 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-96c19389-871f-494f-ad8f-7c1e5f6eba5d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:38.913597 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96c19389-871f-494f-ad8f-7c1e5f6eba5d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:38.914037 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96c19389-871f-494f-ad8f-7c1e5f6eba5d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:38.914830 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96c19389-871f-494f-ad8f-7c1e5f6eba5d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:38.915271 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-96c19389-871f-494f-ad8f-7c1e5f6eba5d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:39.001885 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-96c19389-871f-494f-ad8f-7c1e5f6eba5d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.099080 Oct 28 12:18:39.002523 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 460/927] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:38 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:39.149440 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c5e717f6-927a-4104-88fc-f9e19235ea9c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:39.150076 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c5e717f6-927a-4104-88fc-f9e19235ea9c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:39.156486 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c5e717f6-927a-4104-88fc-f9e19235ea9c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:39.156932 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c5e717f6-927a-4104-88fc-f9e19235ea9c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:39.157694 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c5e717f6-927a-4104-88fc-f9e19235ea9c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:39.158123 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c5e717f6-927a-4104-88fc-f9e19235ea9c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:39.284223 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c5e717f6-927a-4104-88fc-f9e19235ea9c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:39.292051 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c5e717f6-927a-4104-88fc-f9e19235ea9c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.146121 Oct 28 12:18:39.292633 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 468/928] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:39 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:39.401785 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-06ba6cc8-8e00-4000-9db5-09526684a0ea tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:39.402414 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-06ba6cc8-8e00-4000-9db5-09526684a0ea tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:39.409272 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-06ba6cc8-8e00-4000-9db5-09526684a0ea tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:39.409862 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-06ba6cc8-8e00-4000-9db5-09526684a0ea tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:39.410481 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-06ba6cc8-8e00-4000-9db5-09526684a0ea tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:39.410941 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-06ba6cc8-8e00-4000-9db5-09526684a0ea tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:39.540465 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-06ba6cc8-8e00-4000-9db5-09526684a0ea tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:39.549453 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-06ba6cc8-8e00-4000-9db5-09526684a0ea tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:39.550968 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-06ba6cc8-8e00-4000-9db5-09526684a0ea tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:39.552130 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-06ba6cc8-8e00-4000-9db5-09526684a0ea tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.154527 Oct 28 12:18:39.552684 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 461/929] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:39 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:40.013308 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e850d861-e6a4-4528-b976-12fe732e7ebf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:40.014222 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e850d861-e6a4-4528-b976-12fe732e7ebf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:40.020426 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e850d861-e6a4-4528-b976-12fe732e7ebf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:40.020880 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e850d861-e6a4-4528-b976-12fe732e7ebf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:40.021645 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e850d861-e6a4-4528-b976-12fe732e7ebf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:40.022075 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e850d861-e6a4-4528-b976-12fe732e7ebf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:40.082614 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e850d861-e6a4-4528-b976-12fe732e7ebf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.072813 Oct 28 12:18:40.083598 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 469/930] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:40 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:40.308912 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-809385f7-fea9-4014-8dbe-4fb00b93e372 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:40.309508 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-809385f7-fea9-4014-8dbe-4fb00b93e372 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:40.316280 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-809385f7-fea9-4014-8dbe-4fb00b93e372 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:40.316716 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-809385f7-fea9-4014-8dbe-4fb00b93e372 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:40.317467 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-809385f7-fea9-4014-8dbe-4fb00b93e372 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:40.317967 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-809385f7-fea9-4014-8dbe-4fb00b93e372 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:40.434916 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-809385f7-fea9-4014-8dbe-4fb00b93e372 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:40.442122 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-809385f7-fea9-4014-8dbe-4fb00b93e372 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.136803 Oct 28 12:18:40.447577 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 462/931] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:40 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:40.571537 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0160393c-19be-497d-a7ad-38b4a07fc469 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:40.572225 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0160393c-19be-497d-a7ad-38b4a07fc469 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:40.578950 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0160393c-19be-497d-a7ad-38b4a07fc469 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:40.579390 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0160393c-19be-497d-a7ad-38b4a07fc469 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:40.580150 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0160393c-19be-497d-a7ad-38b4a07fc469 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:40.580575 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0160393c-19be-497d-a7ad-38b4a07fc469 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:40.705508 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0160393c-19be-497d-a7ad-38b4a07fc469 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:40.713655 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0160393c-19be-497d-a7ad-38b4a07fc469 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:40.715156 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0160393c-19be-497d-a7ad-38b4a07fc469 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:40.716292 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0160393c-19be-497d-a7ad-38b4a07fc469 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.149021 Oct 28 12:18:40.716848 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 470/932] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:40 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:41.094729 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ed6b89ef-98fe-4aa7-a6f6-dedf39ecb782 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:41.095553 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ed6b89ef-98fe-4aa7-a6f6-dedf39ecb782 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:41.101859 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed6b89ef-98fe-4aa7-a6f6-dedf39ecb782 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:41.102307 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed6b89ef-98fe-4aa7-a6f6-dedf39ecb782 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:41.103114 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed6b89ef-98fe-4aa7-a6f6-dedf39ecb782 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:41.103551 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed6b89ef-98fe-4aa7-a6f6-dedf39ecb782 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:41.165011 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ed6b89ef-98fe-4aa7-a6f6-dedf39ecb782 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.073946 Oct 28 12:18:41.165907 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 463/933] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:41 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:41.350338 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-643a23ab-ac78-4030-b8dd-9209220ba92c req-d9e393c2-b508-4980-a8bc-ed18cab4caba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70", "name": "network-vif-plugged", "status": "completed", "tag": "e2879c41-a82f-4c20-b95f-6aac8fbff5d2"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:41.351916 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:18:41.351916 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:18:41.360340 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-643a23ab-ac78-4030-b8dd-9209220ba92c req-d9e393c2-b508-4980-a8bc-ed18cab4caba service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:41.360769 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-643a23ab-ac78-4030-b8dd-9209220ba92c req-d9e393c2-b508-4980-a8bc-ed18cab4caba service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:41.372413 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-643a23ab-ac78-4030-b8dd-9209220ba92c req-d9e393c2-b508-4980-a8bc-ed18cab4caba service nova] Creating event network-vif-plugged:e2879c41-a82f-4c20-b95f-6aac8fbff5d2 for instance b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 on hv-cinder-81571 Oct 28 12:18:41.377687 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-643a23ab-ac78-4030-b8dd-9209220ba92c req-d9e393c2-b508-4980-a8bc-ed18cab4caba service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030953 Oct 28 12:18:41.378178 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 471/934] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:18:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:18:41.459078 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c385a1cd-93fd-402d-af90-141dd8455a02 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:41.459773 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c385a1cd-93fd-402d-af90-141dd8455a02 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:41.466529 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c385a1cd-93fd-402d-af90-141dd8455a02 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:41.467020 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c385a1cd-93fd-402d-af90-141dd8455a02 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:41.467786 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c385a1cd-93fd-402d-af90-141dd8455a02 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:41.468220 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c385a1cd-93fd-402d-af90-141dd8455a02 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:41.598530 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c385a1cd-93fd-402d-af90-141dd8455a02 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:41.606398 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c385a1cd-93fd-402d-af90-141dd8455a02 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.151304 Oct 28 12:18:41.606948 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 464/935] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:41 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:41.735618 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-999e508e-85fc-4528-aa2f-293df650b2f0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:41.736292 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-999e508e-85fc-4528-aa2f-293df650b2f0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:41.742282 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-999e508e-85fc-4528-aa2f-293df650b2f0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:41.742745 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-999e508e-85fc-4528-aa2f-293df650b2f0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:41.743494 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-999e508e-85fc-4528-aa2f-293df650b2f0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:41.743912 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-999e508e-85fc-4528-aa2f-293df650b2f0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:41.865602 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-999e508e-85fc-4528-aa2f-293df650b2f0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:41.873887 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-999e508e-85fc-4528-aa2f-293df650b2f0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:41.875892 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-999e508e-85fc-4528-aa2f-293df650b2f0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:41.877029 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-999e508e-85fc-4528-aa2f-293df650b2f0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.145860 Oct 28 12:18:41.877570 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 472/936] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:41 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:42.176576 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-54c6c9e7-4148-476c-b963-bc11c0311047 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:42.177509 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-54c6c9e7-4148-476c-b963-bc11c0311047 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:42.183703 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54c6c9e7-4148-476c-b963-bc11c0311047 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:42.184142 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54c6c9e7-4148-476c-b963-bc11c0311047 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:42.184902 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54c6c9e7-4148-476c-b963-bc11c0311047 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:42.185330 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54c6c9e7-4148-476c-b963-bc11c0311047 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:42.358816 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-54c6c9e7-4148-476c-b963-bc11c0311047 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.185679 Oct 28 12:18:42.359958 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 465/937] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:42 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:42.623247 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-09b1a572-2850-479d-9ba6-d9977ddf86c7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:42.623851 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-09b1a572-2850-479d-9ba6-d9977ddf86c7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:42.632487 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-09b1a572-2850-479d-9ba6-d9977ddf86c7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:42.632938 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-09b1a572-2850-479d-9ba6-d9977ddf86c7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:42.633708 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-09b1a572-2850-479d-9ba6-d9977ddf86c7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:42.634137 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-09b1a572-2850-479d-9ba6-d9977ddf86c7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:42.753128 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-09b1a572-2850-479d-9ba6-d9977ddf86c7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:42.760313 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-09b1a572-2850-479d-9ba6-d9977ddf86c7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1313 microversion: 2.1 time: 0.140751 Oct 28 12:18:42.760874 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 473/938] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:42 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:42.895988 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-93228321-cea9-48a9-ba82-98010e156795 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:42.896910 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-93228321-cea9-48a9-ba82-98010e156795 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:42.904503 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93228321-cea9-48a9-ba82-98010e156795 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:42.904963 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93228321-cea9-48a9-ba82-98010e156795 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:42.905718 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93228321-cea9-48a9-ba82-98010e156795 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:42.906633 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-93228321-cea9-48a9-ba82-98010e156795 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:43.029027 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-93228321-cea9-48a9-ba82-98010e156795 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:43.038147 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-93228321-cea9-48a9-ba82-98010e156795 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:43.039638 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-93228321-cea9-48a9-ba82-98010e156795 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:43.040785 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-93228321-cea9-48a9-ba82-98010e156795 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.148844 Oct 28 12:18:43.041337 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 466/939] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:42 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:43.370287 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-44981517-768c-404c-b822-248f3c27f785 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:43.371229 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-44981517-768c-404c-b822-248f3c27f785 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:43.377956 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44981517-768c-404c-b822-248f3c27f785 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:43.378392 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44981517-768c-404c-b822-248f3c27f785 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:43.379174 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44981517-768c-404c-b822-248f3c27f785 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:43.379594 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44981517-768c-404c-b822-248f3c27f785 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:43.507638 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-44981517-768c-404c-b822-248f3c27f785 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.140859 Oct 28 12:18:43.511687 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 474/940] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:43 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:43.778793 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1a972f2a-e898-4478-a000-ee4188a4e5f7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:43.779488 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1a972f2a-e898-4478-a000-ee4188a4e5f7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:43.786030 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a972f2a-e898-4478-a000-ee4188a4e5f7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:43.786479 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a972f2a-e898-4478-a000-ee4188a4e5f7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:43.787323 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a972f2a-e898-4478-a000-ee4188a4e5f7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:43.787753 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a972f2a-e898-4478-a000-ee4188a4e5f7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:43.910993 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1a972f2a-e898-4478-a000-ee4188a4e5f7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:43.918281 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1a972f2a-e898-4478-a000-ee4188a4e5f7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1498 microversion: 2.1 time: 0.144325 Oct 28 12:18:43.918869 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 467/941] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:43 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1498 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:44.059626 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5a6af7f8-52a3-4acf-b15c-e6ede90d1fa4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:44.060342 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5a6af7f8-52a3-4acf-b15c-e6ede90d1fa4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:44.067740 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5a6af7f8-52a3-4acf-b15c-e6ede90d1fa4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:44.068188 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5a6af7f8-52a3-4acf-b15c-e6ede90d1fa4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:44.068951 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5a6af7f8-52a3-4acf-b15c-e6ede90d1fa4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:44.069382 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5a6af7f8-52a3-4acf-b15c-e6ede90d1fa4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:44.194943 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5a6af7f8-52a3-4acf-b15c-e6ede90d1fa4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:44.203995 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5a6af7f8-52a3-4acf-b15c-e6ede90d1fa4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:44.205677 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5a6af7f8-52a3-4acf-b15c-e6ede90d1fa4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:44.206938 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5a6af7f8-52a3-4acf-b15c-e6ede90d1fa4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.151435 Oct 28 12:18:44.207614 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 475/942] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:44 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:44.519862 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7949f306-200e-4875-a1c5-274245f33bfa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:44.520681 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7949f306-200e-4875-a1c5-274245f33bfa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:44.526891 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7949f306-200e-4875-a1c5-274245f33bfa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:44.527338 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7949f306-200e-4875-a1c5-274245f33bfa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:44.528100 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7949f306-200e-4875-a1c5-274245f33bfa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:44.528527 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7949f306-200e-4875-a1c5-274245f33bfa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:45.225066 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-58afbcb7-caca-4a56-b683-a6f06100ad5b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:45.225637 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-58afbcb7-caca-4a56-b683-a6f06100ad5b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:45.231811 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58afbcb7-caca-4a56-b683-a6f06100ad5b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:45.232247 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58afbcb7-caca-4a56-b683-a6f06100ad5b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:45.232994 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58afbcb7-caca-4a56-b683-a6f06100ad5b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:45.233424 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58afbcb7-caca-4a56-b683-a6f06100ad5b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:45.354980 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-58afbcb7-caca-4a56-b683-a6f06100ad5b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:45.363604 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-58afbcb7-caca-4a56-b683-a6f06100ad5b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:45.365097 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-58afbcb7-caca-4a56-b683-a6f06100ad5b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:45.366234 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-58afbcb7-caca-4a56-b683-a6f06100ad5b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.144868 Oct 28 12:18:45.366815 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 476/943] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:45 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:46.384810 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-750d22a5-ed8c-4fd1-ab7a-0f4e60d3ecd5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:46.385395 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-750d22a5-ed8c-4fd1-ab7a-0f4e60d3ecd5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:46.391559 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-750d22a5-ed8c-4fd1-ab7a-0f4e60d3ecd5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:46.392002 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-750d22a5-ed8c-4fd1-ab7a-0f4e60d3ecd5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:46.392763 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-750d22a5-ed8c-4fd1-ab7a-0f4e60d3ecd5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:46.393189 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-750d22a5-ed8c-4fd1-ab7a-0f4e60d3ecd5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:46.517877 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-750d22a5-ed8c-4fd1-ab7a-0f4e60d3ecd5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:46.526091 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-750d22a5-ed8c-4fd1-ab7a-0f4e60d3ecd5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:46.527582 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-750d22a5-ed8c-4fd1-ab7a-0f4e60d3ecd5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:46.528724 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-750d22a5-ed8c-4fd1-ab7a-0f4e60d3ecd5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.147645 Oct 28 12:18:46.529265 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 477/944] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:46 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:47.547199 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d344d76a-f126-400e-89fb-9a4b76806a10 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:47.547868 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d344d76a-f126-400e-89fb-9a4b76806a10 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:47.553934 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d344d76a-f126-400e-89fb-9a4b76806a10 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:47.554374 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d344d76a-f126-400e-89fb-9a4b76806a10 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:47.555168 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d344d76a-f126-400e-89fb-9a4b76806a10 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:47.555590 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d344d76a-f126-400e-89fb-9a4b76806a10 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:47.674642 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d344d76a-f126-400e-89fb-9a4b76806a10 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:47.682832 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d344d76a-f126-400e-89fb-9a4b76806a10 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:47.684337 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d344d76a-f126-400e-89fb-9a4b76806a10 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:47.685479 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d344d76a-f126-400e-89fb-9a4b76806a10 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.142224 Oct 28 12:18:47.686041 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 478/945] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:47 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:48.702901 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-174c41da-80ee-43a8-ad4e-5f074889acbb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:48.703585 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-174c41da-80ee-43a8-ad4e-5f074889acbb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:48.709744 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-174c41da-80ee-43a8-ad4e-5f074889acbb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:48.710173 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-174c41da-80ee-43a8-ad4e-5f074889acbb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:48.710953 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-174c41da-80ee-43a8-ad4e-5f074889acbb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:48.711375 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-174c41da-80ee-43a8-ad4e-5f074889acbb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:48.838187 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-174c41da-80ee-43a8-ad4e-5f074889acbb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:48.846931 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-174c41da-80ee-43a8-ad4e-5f074889acbb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:48.848426 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-174c41da-80ee-43a8-ad4e-5f074889acbb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:48.849597 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-174c41da-80ee-43a8-ad4e-5f074889acbb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.150525 Oct 28 12:18:48.850118 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 479/946] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:48 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:48.934089 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7949f306-200e-4875-a1c5-274245f33bfa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 4.418313 Oct 28 12:18:48.934748 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 468/947] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:44 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 4420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:49.868407 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2f8c9b5a-fc01-4efa-82b3-ce6ae9fa64c0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:49.868929 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2f8c9b5a-fc01-4efa-82b3-ce6ae9fa64c0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:49.876331 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f8c9b5a-fc01-4efa-82b3-ce6ae9fa64c0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:49.877102 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f8c9b5a-fc01-4efa-82b3-ce6ae9fa64c0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:49.878456 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f8c9b5a-fc01-4efa-82b3-ce6ae9fa64c0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:49.879283 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f8c9b5a-fc01-4efa-82b3-ce6ae9fa64c0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:49.945672 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-66991cbc-983a-4d8e-b9cf-af0198f944ea tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:49.946661 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-66991cbc-983a-4d8e-b9cf-af0198f944ea tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:49.965134 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-66991cbc-983a-4d8e-b9cf-af0198f944ea tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:49.965594 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-66991cbc-983a-4d8e-b9cf-af0198f944ea tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:49.966373 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-66991cbc-983a-4d8e-b9cf-af0198f944ea tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:49.967014 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-66991cbc-983a-4d8e-b9cf-af0198f944ea tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:50.037606 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2f8c9b5a-fc01-4efa-82b3-ce6ae9fa64c0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:50.042229 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-66991cbc-983a-4d8e-b9cf-af0198f944ea tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.100430 Oct 28 12:18:50.044039 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 469/948] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:49 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:50.050323 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2f8c9b5a-fc01-4efa-82b3-ce6ae9fa64c0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:50.052714 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2f8c9b5a-fc01-4efa-82b3-ce6ae9fa64c0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:50.054504 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2f8c9b5a-fc01-4efa-82b3-ce6ae9fa64c0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.189691 Oct 28 12:18:50.056297 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 480/949] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:49 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:50.087224 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9b7405a6-0791-441f-a180-df4bff927025 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:50.088231 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9b7405a6-0791-441f-a180-df4bff927025 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:50.100215 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9b7405a6-0791-441f-a180-df4bff927025 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:50.100215 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9b7405a6-0791-441f-a180-df4bff927025 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:50.100215 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9b7405a6-0791-441f-a180-df4bff927025 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:50.100215 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9b7405a6-0791-441f-a180-df4bff927025 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:50.126718 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9b7405a6-0791-441f-a180-df4bff927025 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:18:50.200307 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9b7405a6-0791-441f-a180-df4bff927025 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "DELETE /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 204 len: 0 microversion: 2.1 time: 0.117270 Oct 28 12:18:50.200889 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 470/950] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:18:50 2021] DELETE /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:18:50.209750 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ac9cbc39-587e-4413-9391-c6e4d6ad09a4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:50.210363 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ac9cbc39-587e-4413-9391-c6e4d6ad09a4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:50.216060 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ac9cbc39-587e-4413-9391-c6e4d6ad09a4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:50.216506 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ac9cbc39-587e-4413-9391-c6e4d6ad09a4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:50.217267 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ac9cbc39-587e-4413-9391-c6e4d6ad09a4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:50.217697 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ac9cbc39-587e-4413-9391-c6e4d6ad09a4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:50.340818 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ac9cbc39-587e-4413-9391-c6e4d6ad09a4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:50.348430 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ac9cbc39-587e-4413-9391-c6e4d6ad09a4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1504 microversion: 2.1 time: 0.142745 Oct 28 12:18:50.348986 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 481/951] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:50 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1504 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:51.055589 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-356722ef-5b34-476c-8fe8-144b7439f57e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:51.056576 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-356722ef-5b34-476c-8fe8-144b7439f57e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:51.063272 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-356722ef-5b34-476c-8fe8-144b7439f57e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:51.063717 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-356722ef-5b34-476c-8fe8-144b7439f57e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:51.064480 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-356722ef-5b34-476c-8fe8-144b7439f57e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:51.064912 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-356722ef-5b34-476c-8fe8-144b7439f57e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:51.073962 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ec1ad3a7-a404-4e5d-933a-5210aaf6c6f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:51.074605 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ec1ad3a7-a404-4e5d-933a-5210aaf6c6f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:51.081295 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ec1ad3a7-a404-4e5d-933a-5210aaf6c6f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:51.081730 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ec1ad3a7-a404-4e5d-933a-5210aaf6c6f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:51.082481 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ec1ad3a7-a404-4e5d-933a-5210aaf6c6f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:51.082940 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ec1ad3a7-a404-4e5d-933a-5210aaf6c6f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:51.207371 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ec1ad3a7-a404-4e5d-933a-5210aaf6c6f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:51.215423 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ec1ad3a7-a404-4e5d-933a-5210aaf6c6f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:51.216896 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ec1ad3a7-a404-4e5d-933a-5210aaf6c6f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:51.218070 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ec1ad3a7-a404-4e5d-933a-5210aaf6c6f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.147760 Oct 28 12:18:51.218694 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 482/952] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:51 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:51.366100 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dd540c34-8054-41ba-b0ce-72c6b3ff68ae tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:51.366726 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dd540c34-8054-41ba-b0ce-72c6b3ff68ae tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:51.373133 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dd540c34-8054-41ba-b0ce-72c6b3ff68ae tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:51.373578 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dd540c34-8054-41ba-b0ce-72c6b3ff68ae tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:51.374341 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dd540c34-8054-41ba-b0ce-72c6b3ff68ae tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:51.375456 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dd540c34-8054-41ba-b0ce-72c6b3ff68ae tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:51.493356 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-dd540c34-8054-41ba-b0ce-72c6b3ff68ae tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:51.501263 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dd540c34-8054-41ba-b0ce-72c6b3ff68ae tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1504 microversion: 2.1 time: 0.139314 Oct 28 12:18:51.501837 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 483/953] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:51 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1504 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:52.235791 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-705509a7-2cec-44c2-9b93-8b97a7889563 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:52.236391 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-705509a7-2cec-44c2-9b93-8b97a7889563 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:52.242734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-705509a7-2cec-44c2-9b93-8b97a7889563 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:52.243175 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-705509a7-2cec-44c2-9b93-8b97a7889563 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:52.243924 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-705509a7-2cec-44c2-9b93-8b97a7889563 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:52.244347 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-705509a7-2cec-44c2-9b93-8b97a7889563 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:52.365557 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-705509a7-2cec-44c2-9b93-8b97a7889563 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:52.373594 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-705509a7-2cec-44c2-9b93-8b97a7889563 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:52.375614 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-705509a7-2cec-44c2-9b93-8b97a7889563 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:52.376809 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-705509a7-2cec-44c2-9b93-8b97a7889563 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.144660 Oct 28 12:18:52.377381 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 484/954] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:52 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:52.517423 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4d6be6de-c243-433b-a862-db0e0173a379 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:52.517920 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4d6be6de-c243-433b-a862-db0e0173a379 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:52.523578 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4d6be6de-c243-433b-a862-db0e0173a379 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:52.524014 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4d6be6de-c243-433b-a862-db0e0173a379 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:52.524763 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4d6be6de-c243-433b-a862-db0e0173a379 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:52.525185 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4d6be6de-c243-433b-a862-db0e0173a379 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:52.650630 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4d6be6de-c243-433b-a862-db0e0173a379 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:52.657916 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4d6be6de-c243-433b-a862-db0e0173a379 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1504 microversion: 2.1 time: 0.144568 Oct 28 12:18:52.658478 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 485/955] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:52 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1504 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:53.394860 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8aff4efd-bf3f-488c-b676-f4cf38c014b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:53.395495 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8aff4efd-bf3f-488c-b676-f4cf38c014b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:53.401642 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8aff4efd-bf3f-488c-b676-f4cf38c014b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:53.402081 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8aff4efd-bf3f-488c-b676-f4cf38c014b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:53.402876 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8aff4efd-bf3f-488c-b676-f4cf38c014b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:53.403297 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8aff4efd-bf3f-488c-b676-f4cf38c014b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:53.523093 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8aff4efd-bf3f-488c-b676-f4cf38c014b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:53.531759 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8aff4efd-bf3f-488c-b676-f4cf38c014b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:53.533244 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8aff4efd-bf3f-488c-b676-f4cf38c014b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:53.534386 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8aff4efd-bf3f-488c-b676-f4cf38c014b3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.143244 Oct 28 12:18:53.534978 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 486/956] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:53 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:18:53.675130 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-744e45bc-cd8f-4955-b3bc-320e2afc8325 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:53.675725 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-744e45bc-cd8f-4955-b3bc-320e2afc8325 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:53.681570 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-744e45bc-cd8f-4955-b3bc-320e2afc8325 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:53.682004 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-744e45bc-cd8f-4955-b3bc-320e2afc8325 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:53.682786 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-744e45bc-cd8f-4955-b3bc-320e2afc8325 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:53.683213 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-744e45bc-cd8f-4955-b3bc-320e2afc8325 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:53.801966 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-744e45bc-cd8f-4955-b3bc-320e2afc8325 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:53.809215 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-744e45bc-cd8f-4955-b3bc-320e2afc8325 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1504 microversion: 2.1 time: 0.137630 Oct 28 12:18:53.809786 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 487/957] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:53 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1504 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:18:54.248758 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-356722ef-5b34-476c-8fe8-144b7439f57e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 3.197010 Oct 28 12:18:54.250225 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 471/958] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:51 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 3199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:54.552543 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fe27d8ad-3a7f-476b-9313-9d245bc795b7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:54.553144 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fe27d8ad-3a7f-476b-9313-9d245bc795b7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:54.559353 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe27d8ad-3a7f-476b-9313-9d245bc795b7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:54.559799 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe27d8ad-3a7f-476b-9313-9d245bc795b7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:54.560560 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe27d8ad-3a7f-476b-9313-9d245bc795b7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:54.560990 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe27d8ad-3a7f-476b-9313-9d245bc795b7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:54.684351 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fe27d8ad-3a7f-476b-9313-9d245bc795b7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:54.693076 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fe27d8ad-3a7f-476b-9313-9d245bc795b7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:54.694545 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fe27d8ad-3a7f-476b-9313-9d245bc795b7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:54.695704 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fe27d8ad-3a7f-476b-9313-9d245bc795b7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.146926 Oct 28 12:18:54.696271 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 488/959] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:54 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:54.825891 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8f6f8af8-7988-46fb-b2cd-55c38b4e6d22 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:54.826503 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8f6f8af8-7988-46fb-b2cd-55c38b4e6d22 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:54.834472 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f6f8af8-7988-46fb-b2cd-55c38b4e6d22 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:54.834939 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f6f8af8-7988-46fb-b2cd-55c38b4e6d22 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:54.835708 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f6f8af8-7988-46fb-b2cd-55c38b4e6d22 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:54.836136 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f6f8af8-7988-46fb-b2cd-55c38b4e6d22 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:54.954332 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8f6f8af8-7988-46fb-b2cd-55c38b4e6d22 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:54.961850 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8f6f8af8-7988-46fb-b2cd-55c38b4e6d22 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1504 microversion: 2.1 time: 0.140131 Oct 28 12:18:54.962408 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 472/960] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:54 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1504 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:55.260847 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c59d7c74-3207-4d37-aead-611da379fc16 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:55.261741 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c59d7c74-3207-4d37-aead-611da379fc16 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:55.267680 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c59d7c74-3207-4d37-aead-611da379fc16 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:55.268130 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c59d7c74-3207-4d37-aead-611da379fc16 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:55.268903 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c59d7c74-3207-4d37-aead-611da379fc16 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:55.269338 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c59d7c74-3207-4d37-aead-611da379fc16 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:55.333857 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c59d7c74-3207-4d37-aead-611da379fc16 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.076849 Oct 28 12:18:55.334495 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 489/961] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:55 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:55.714744 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fbc13778-78ac-4c95-bb32-cb54ecd86cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:55.715374 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fbc13778-78ac-4c95-bb32-cb54ecd86cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:55.722047 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fbc13778-78ac-4c95-bb32-cb54ecd86cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:55.722487 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fbc13778-78ac-4c95-bb32-cb54ecd86cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:55.723294 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fbc13778-78ac-4c95-bb32-cb54ecd86cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:55.723801 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fbc13778-78ac-4c95-bb32-cb54ecd86cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:55.851738 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fbc13778-78ac-4c95-bb32-cb54ecd86cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:55.859937 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fbc13778-78ac-4c95-bb32-cb54ecd86cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:55.861971 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fbc13778-78ac-4c95-bb32-cb54ecd86cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:55.863241 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fbc13778-78ac-4c95-bb32-cb54ecd86cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.152238 Oct 28 12:18:55.864003 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 473/962] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:55 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:55.870299 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-9736900e-6249-42e9-b0ae-234d29924cfb req-913b93ed-10d0-4ed2-b796-981128362289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79ab524-bc96-45ce-91df-6713d6fcaaaf", "name": "network-vif-plugged", "status": "completed", "tag": "f783de9c-03e4-446f-b34b-e2edaa551d3c"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:55.870299 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:18:55.870299 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:18:55.875400 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-9736900e-6249-42e9-b0ae-234d29924cfb req-913b93ed-10d0-4ed2-b796-981128362289 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:55.875873 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-9736900e-6249-42e9-b0ae-234d29924cfb req-913b93ed-10d0-4ed2-b796-981128362289 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:55.888466 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-9736900e-6249-42e9-b0ae-234d29924cfb req-913b93ed-10d0-4ed2-b796-981128362289 service nova] Creating event network-vif-plugged:f783de9c-03e4-446f-b34b-e2edaa551d3c for instance d79ab524-bc96-45ce-91df-6713d6fcaaaf on hv-cinder-81571 Oct 28 12:18:55.893831 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-9736900e-6249-42e9-b0ae-234d29924cfb req-913b93ed-10d0-4ed2-b796-981128362289 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032204 Oct 28 12:18:55.894435 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 490/963] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:18:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:18:55.978034 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1e51e71c-cdf8-49a5-9b20-d25769923e14 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:55.978632 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1e51e71c-cdf8-49a5-9b20-d25769923e14 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:55.984578 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1e51e71c-cdf8-49a5-9b20-d25769923e14 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:55.985025 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1e51e71c-cdf8-49a5-9b20-d25769923e14 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:55.985808 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1e51e71c-cdf8-49a5-9b20-d25769923e14 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:55.986267 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1e51e71c-cdf8-49a5-9b20-d25769923e14 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:56.109277 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1e51e71c-cdf8-49a5-9b20-d25769923e14 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:56.116666 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1e51e71c-cdf8-49a5-9b20-d25769923e14 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1504 microversion: 2.1 time: 0.142242 Oct 28 12:18:56.117237 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 474/964] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:55 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1504 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:56.345734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-485f56db-5b2a-4ddd-ab86-5395030c4bda tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:56.347468 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-485f56db-5b2a-4ddd-ab86-5395030c4bda tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:56.355485 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-485f56db-5b2a-4ddd-ab86-5395030c4bda tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:56.356551 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-485f56db-5b2a-4ddd-ab86-5395030c4bda tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:56.356738 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-485f56db-5b2a-4ddd-ab86-5395030c4bda tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:56.358204 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-485f56db-5b2a-4ddd-ab86-5395030c4bda tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:56.464472 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-77e0c072-b548-4fc1-bbab-37b349084026 req-c642d2c2-def6-407a-bebe-6382bd63a8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70", "name": "network-vif-deleted", "tag": "e2879c41-a82f-4c20-b95f-6aac8fbff5d2"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:56.466469 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:18:56.466469 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:18:56.472820 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-485f56db-5b2a-4ddd-ab86-5395030c4bda tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.130792 Oct 28 12:18:56.474155 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 491/965] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:56 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:18:56.477213 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-77e0c072-b548-4fc1-bbab-37b349084026 req-c642d2c2-def6-407a-bebe-6382bd63a8f0 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:56.477658 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-77e0c072-b548-4fc1-bbab-37b349084026 req-c642d2c2-def6-407a-bebe-6382bd63a8f0 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:56.490044 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-77e0c072-b548-4fc1-bbab-37b349084026 req-c642d2c2-def6-407a-bebe-6382bd63a8f0 service nova] Creating event network-vif-deleted:e2879c41-a82f-4c20-b95f-6aac8fbff5d2 for instance b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 on hv-cinder-81571 Oct 28 12:18:56.494986 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-77e0c072-b548-4fc1-bbab-37b349084026 req-c642d2c2-def6-407a-bebe-6382bd63a8f0 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034162 Oct 28 12:18:56.495592 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 475/966] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:18:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:18:56.881924 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a3dbf685-b858-4fa9-add3-ce93826dbd7e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:56.883192 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a3dbf685-b858-4fa9-add3-ce93826dbd7e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:56.890472 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a3dbf685-b858-4fa9-add3-ce93826dbd7e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:56.890943 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a3dbf685-b858-4fa9-add3-ce93826dbd7e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:56.891718 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a3dbf685-b858-4fa9-add3-ce93826dbd7e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:56.892146 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a3dbf685-b858-4fa9-add3-ce93826dbd7e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:57.013452 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a3dbf685-b858-4fa9-add3-ce93826dbd7e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:57.021864 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a3dbf685-b858-4fa9-add3-ce93826dbd7e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:57.023393 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a3dbf685-b858-4fa9-add3-ce93826dbd7e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:57.024535 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a3dbf685-b858-4fa9-add3-ce93826dbd7e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.146739 Oct 28 12:18:57.025084 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 492/967] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:56 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:57.134136 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6c2e0900-1baa-4930-a004-de9a34d9be64 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:57.135027 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6c2e0900-1baa-4930-a004-de9a34d9be64 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:57.141290 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c2e0900-1baa-4930-a004-de9a34d9be64 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:57.141729 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c2e0900-1baa-4930-a004-de9a34d9be64 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:57.142486 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c2e0900-1baa-4930-a004-de9a34d9be64 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:57.142936 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c2e0900-1baa-4930-a004-de9a34d9be64 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:57.172852 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c2e0900-1baa-4930-a004-de9a34d9be64 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:57.173286 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c2e0900-1baa-4930-a004-de9a34d9be64 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:57.173719 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-6c2e0900-1baa-4930-a004-de9a34d9be64 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lazy-loading 'fault' on Instance uuid b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:18:57.212820 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6c2e0900-1baa-4930-a004-de9a34d9be64 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:57.221458 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6c2e0900-1baa-4930-a004-de9a34d9be64 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 200 len: 1303 microversion: 2.1 time: 0.091929 Oct 28 12:18:57.222036 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 476/968] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:57 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:57.484165 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-345a0dd5-0588-4283-b24b-d2402df6fb04 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:57.485078 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-345a0dd5-0588-4283-b24b-d2402df6fb04 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:57.491186 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-345a0dd5-0588-4283-b24b-d2402df6fb04 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:57.491624 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-345a0dd5-0588-4283-b24b-d2402df6fb04 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:57.492384 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-345a0dd5-0588-4283-b24b-d2402df6fb04 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:57.492804 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-345a0dd5-0588-4283-b24b-d2402df6fb04 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:57.609620 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-345a0dd5-0588-4283-b24b-d2402df6fb04 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.128951 Oct 28 12:18:57.610488 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 493/969] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:57 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:58.043424 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3985a2a6-cf7b-491f-b9f7-a083badb07ee tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:58.044052 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3985a2a6-cf7b-491f-b9f7-a083badb07ee tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:58.050657 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3985a2a6-cf7b-491f-b9f7-a083badb07ee tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:58.051126 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3985a2a6-cf7b-491f-b9f7-a083badb07ee tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:58.051883 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3985a2a6-cf7b-491f-b9f7-a083badb07ee tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:58.052318 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3985a2a6-cf7b-491f-b9f7-a083badb07ee tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:58.173504 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3985a2a6-cf7b-491f-b9f7-a083badb07ee tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:58.181953 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3985a2a6-cf7b-491f-b9f7-a083badb07ee tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:58.183718 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3985a2a6-cf7b-491f-b9f7-a083badb07ee tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:58.185108 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3985a2a6-cf7b-491f-b9f7-a083badb07ee tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1807 microversion: 2.20 time: 0.145314 Oct 28 12:18:58.185869 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 477/970] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:58 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:58.238993 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dfdfa146-916d-4c57-884b-d3b3b3ef8ba4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:58.239684 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dfdfa146-916d-4c57-884b-d3b3b3ef8ba4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:58.246477 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dfdfa146-916d-4c57-884b-d3b3b3ef8ba4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:58.246961 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dfdfa146-916d-4c57-884b-d3b3b3ef8ba4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:58.247730 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dfdfa146-916d-4c57-884b-d3b3b3ef8ba4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:58.248160 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dfdfa146-916d-4c57-884b-d3b3b3ef8ba4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:58.262405 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-dfdfa146-916d-4c57-884b-d3b3b3ef8ba4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] HTTP exception thrown: Instance b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 could not be found. Oct 28 12:18:58.263015 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dfdfa146-916d-4c57-884b-d3b3b3ef8ba4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Returning 404 to user: Instance b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:18:58.263826 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dfdfa146-916d-4c57-884b-d3b3b3ef8ba4 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70" status: 404 len: 111 microversion: 2.1 time: 0.028952 Oct 28 12:18:58.264364 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 494/971] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:58 2021] GET /compute/v2.1/servers/b6ce79f6-8e4b-442a-86d6-0ac8dd28ba70 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:18:58.314131 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ec5c4a31-8ea4-4c54-af82-d3fbc2aa2bbe tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1806483716", "imageRef": "4385a199-a3e9-4c11-b580-60e7a24d0e97", "flavorRef": "452", "networks": [{"uuid": "572ded8c-dc2b-4461-bf0f-b2ba86459f25"}]}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:58.366161 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-ec5c4a31-8ea4-4c54-af82-d3fbc2aa2bbe tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] validate_networks() for [('572ded8c-dc2b-4461-bf0f-b2ba86459f25', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:18:58.574986 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-77296a5f-b0ec-44ae-8005-2c54fd422451 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:58.575482 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-77296a5f-b0ec-44ae-8005-2c54fd422451 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:58.583784 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77296a5f-b0ec-44ae-8005-2c54fd422451 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:58.584228 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77296a5f-b0ec-44ae-8005-2c54fd422451 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:58.585000 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77296a5f-b0ec-44ae-8005-2c54fd422451 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:58.586180 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77296a5f-b0ec-44ae-8005-2c54fd422451 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:58.672805 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-77296a5f-b0ec-44ae-8005-2c54fd422451 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lazy-loading 'services' on Instance uuid ea6bc04f-095b-4b34-a107-3dbbd1d776fe {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:18:58.739142 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-ec5c4a31-8ea4-4c54-af82-d3fbc2aa2bbe tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:18:58.739757 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-ec5c4a31-8ea4-4c54-af82-d3fbc2aa2bbe tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:18:58.740261 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-ec5c4a31-8ea4-4c54-af82-d3fbc2aa2bbe tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:18:58.740669 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-ec5c4a31-8ea4-4c54-af82-d3fbc2aa2bbe tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:18:58.741074 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-ec5c4a31-8ea4-4c54-af82-d3fbc2aa2bbe tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:18:58.750418 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ec5c4a31-8ea4-4c54-af82-d3fbc2aa2bbe tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:58.750912 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ec5c4a31-8ea4-4c54-af82-d3fbc2aa2bbe tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:58.751732 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ec5c4a31-8ea4-4c54-af82-d3fbc2aa2bbe tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:58.752146 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ec5c4a31-8ea4-4c54-af82-d3fbc2aa2bbe tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:58.752811 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-77296a5f-b0ec-44ae-8005-2c54fd422451 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "DELETE /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe/os-volume_attachments/ab8eb6d4-2821-40b2-bc94-4da3ba7ecb9b" status: 202 len: 0 microversion: 2.1 time: 0.181673 Oct 28 12:18:58.753828 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 495/972] 10.222.0.37 () {58 vars in 1415 bytes} [Thu Oct 28 12:18:58 2021] DELETE /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe/os-volume_attachments/ab8eb6d4-2821-40b2-bc94-4da3ba7ecb9b => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:18:58.774493 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-ec5c4a31-8ea4-4c54-af82-d3fbc2aa2bbe tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Getting quotas for project 2307f41d09814947a921545ae8b32a1e. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:18:58.776118 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e07fc66d-58d6-49a7-bd22-cedea93fc70f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:58.778614 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-ec5c4a31-8ea4-4c54-af82-d3fbc2aa2bbe tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Getting quotas for user 3d5416fdd41f47f88f05148c94b7af74 and project 2307f41d09814947a921545ae8b32a1e. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:18:58.780461 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e07fc66d-58d6-49a7-bd22-cedea93fc70f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:58.789115 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e07fc66d-58d6-49a7-bd22-cedea93fc70f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:58.789564 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e07fc66d-58d6-49a7-bd22-cedea93fc70f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:58.796252 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e07fc66d-58d6-49a7-bd22-cedea93fc70f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:58.797103 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e07fc66d-58d6-49a7-bd22-cedea93fc70f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:58.803169 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ec5c4a31-8ea4-4c54-af82-d3fbc2aa2bbe tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:18:58.805513 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ec5c4a31-8ea4-4c54-af82-d3fbc2aa2bbe tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4385a199-a3e9-4c11-b580-60e7a24d0e97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:18:58.865968 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ec5c4a31-8ea4-4c54-af82-d3fbc2aa2bbe tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555952 Oct 28 12:18:58.869618 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 478/973] 10.222.0.37 () {60 vars in 1146 bytes} [Thu Oct 28 12:18:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 12:18:58.881806 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e8fbb0df-0599-4ee2-b97d-251ad346d8b8 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:58.882420 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e8fbb0df-0599-4ee2-b97d-251ad346d8b8 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:58.888138 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e07fc66d-58d6-49a7-bd22-cedea93fc70f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.132807 Oct 28 12:18:58.889207 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 496/974] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:58 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:18:58.941339 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e8fbb0df-0599-4ee2-b97d-251ad346d8b8 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:58.948133 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e8fbb0df-0599-4ee2-b97d-251ad346d8b8 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1214 microversion: 2.1 time: 0.072141 Oct 28 12:18:58.949017 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 479/975] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:58 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:18:59.205134 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-52983c87-65e5-4ee6-9373-be628f7a58bc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:59.205931 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-52983c87-65e5-4ee6-9373-be628f7a58bc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:59.213380 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-52983c87-65e5-4ee6-9373-be628f7a58bc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:59.213890 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-52983c87-65e5-4ee6-9373-be628f7a58bc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:59.214767 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-52983c87-65e5-4ee6-9373-be628f7a58bc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:59.215262 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-52983c87-65e5-4ee6-9373-be628f7a58bc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:59.339860 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-52983c87-65e5-4ee6-9373-be628f7a58bc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:59.349536 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-52983c87-65e5-4ee6-9373-be628f7a58bc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:59.351286 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-52983c87-65e5-4ee6-9373-be628f7a58bc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:18:59.352731 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-52983c87-65e5-4ee6-9373-be628f7a58bc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1794 microversion: 2.20 time: 0.152083 Oct 28 12:18:59.353759 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 497/976] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:18:59 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1794 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:18:59.876347 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-dd01122d-ecec-441d-8feb-756bab508558 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:18:59.877041 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-dd01122d-ecec-441d-8feb-756bab508558 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:59.884599 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd01122d-ecec-441d-8feb-756bab508558 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:59.885044 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd01122d-ecec-441d-8feb-756bab508558 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:59.885995 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd01122d-ecec-441d-8feb-756bab508558 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:59.886428 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd01122d-ecec-441d-8feb-756bab508558 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:59.905398 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bc374b57-9f30-4fdb-a92d-29c0397e13bf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:18:59.912070 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-dd01122d-ecec-441d-8feb-756bab508558 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:18:59.913218 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bc374b57-9f30-4fdb-a92d-29c0397e13bf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:18:59.921162 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc374b57-9f30-4fdb-a92d-29c0397e13bf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:59.922010 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc374b57-9f30-4fdb-a92d-29c0397e13bf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:59.923723 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc374b57-9f30-4fdb-a92d-29c0397e13bf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:18:59.924452 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc374b57-9f30-4fdb-a92d-29c0397e13bf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:18:59.996500 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-dd01122d-ecec-441d-8feb-756bab508558 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "DELETE /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 204 len: 0 microversion: 2.1 time: 0.123922 Oct 28 12:18:59.998764 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 480/977] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:18:59 2021] DELETE /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:19:00.006961 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-de0e09a1-0f4a-49b6-97cf-cb7ce3965763 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:00.008722 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-de0e09a1-0f4a-49b6-97cf-cb7ce3965763 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:00.015627 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-de0e09a1-0f4a-49b6-97cf-cb7ce3965763 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:00.016349 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-de0e09a1-0f4a-49b6-97cf-cb7ce3965763 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:00.017127 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-de0e09a1-0f4a-49b6-97cf-cb7ce3965763 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:00.017560 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-de0e09a1-0f4a-49b6-97cf-cb7ce3965763 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:00.049982 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bc374b57-9f30-4fdb-a92d-29c0397e13bf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.152700 Oct 28 12:19:00.054529 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 498/978] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:18:59 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:19:00.059847 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-eaea6cd0-a369-4213-9a58-aad6a0ed22e6 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:00.060593 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-eaea6cd0-a369-4213-9a58-aad6a0ed22e6 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:00.069526 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eaea6cd0-a369-4213-9a58-aad6a0ed22e6 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:00.070052 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eaea6cd0-a369-4213-9a58-aad6a0ed22e6 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:00.070941 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eaea6cd0-a369-4213-9a58-aad6a0ed22e6 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:00.071454 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eaea6cd0-a369-4213-9a58-aad6a0ed22e6 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:00.099640 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-de0e09a1-0f4a-49b6-97cf-cb7ce3965763 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:00.107748 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-de0e09a1-0f4a-49b6-97cf-cb7ce3965763 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1272 microversion: 2.1 time: 0.106790 Oct 28 12:19:00.109436 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 481/979] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:18:59 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:19:00.275443 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-eaea6cd0-a369-4213-9a58-aad6a0ed22e6 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:00.282670 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-eaea6cd0-a369-4213-9a58-aad6a0ed22e6 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1513 microversion: 2.1 time: 0.226707 Oct 28 12:19:00.283261 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 499/980] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:00 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:19:01.061446 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-42960f97-4860-40f7-aa4b-d8ebe31d23b3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:01.062443 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-42960f97-4860-40f7-aa4b-d8ebe31d23b3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:01.068995 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-42960f97-4860-40f7-aa4b-d8ebe31d23b3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:01.069437 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-42960f97-4860-40f7-aa4b-d8ebe31d23b3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:01.070199 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-42960f97-4860-40f7-aa4b-d8ebe31d23b3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:01.070625 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-42960f97-4860-40f7-aa4b-d8ebe31d23b3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:01.124053 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e75f0f80-ded1-4d25-8c36-cff2e765872c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:01.124686 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e75f0f80-ded1-4d25-8c36-cff2e765872c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:01.131150 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e75f0f80-ded1-4d25-8c36-cff2e765872c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:01.131584 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e75f0f80-ded1-4d25-8c36-cff2e765872c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:01.132344 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e75f0f80-ded1-4d25-8c36-cff2e765872c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:01.132767 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e75f0f80-ded1-4d25-8c36-cff2e765872c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:01.143655 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-42960f97-4860-40f7-aa4b-d8ebe31d23b3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.085771 Oct 28 12:19:01.145235 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 482/981] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:01 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:01.301122 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-abeb178c-1786-43e6-ad79-e4e1bdafd441 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:01.301821 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-abeb178c-1786-43e6-ad79-e4e1bdafd441 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:01.308769 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-abeb178c-1786-43e6-ad79-e4e1bdafd441 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:01.309214 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-abeb178c-1786-43e6-ad79-e4e1bdafd441 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:01.309978 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-abeb178c-1786-43e6-ad79-e4e1bdafd441 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:01.310409 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-abeb178c-1786-43e6-ad79-e4e1bdafd441 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:01.319340 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e75f0f80-ded1-4d25-8c36-cff2e765872c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:01.326960 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e75f0f80-ded1-4d25-8c36-cff2e765872c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1314 microversion: 2.1 time: 0.206496 Oct 28 12:19:01.328512 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 500/982] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:01 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:19:01.362989 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-7ee21d00-fb28-4921-9f07-cc365037672c req-5f919bfd-d81b-4b61-b534-9153bca29628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae38635-e55c-40f1-824f-bfba6f254390", "tag": "457e28ae-6a99-4a85-93df-a34245f9b7a5"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:01.365907 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:19:01.365907 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:19:01.375072 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-7ee21d00-fb28-4921-9f07-cc365037672c req-5f919bfd-d81b-4b61-b534-9153bca29628 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:01.375510 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-7ee21d00-fb28-4921-9f07-cc365037672c req-5f919bfd-d81b-4b61-b534-9153bca29628 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:01.387069 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-7ee21d00-fb28-4921-9f07-cc365037672c req-5f919bfd-d81b-4b61-b534-9153bca29628 service nova] Creating event network-changed:457e28ae-6a99-4a85-93df-a34245f9b7a5 for instance 5ae38635-e55c-40f1-824f-bfba6f254390 on hv-cinder-81571 Oct 28 12:19:01.394429 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-7ee21d00-fb28-4921-9f07-cc365037672c req-5f919bfd-d81b-4b61-b534-9153bca29628 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035678 Oct 28 12:19:01.395384 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 501/983] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:19:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:19:01.440511 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-abeb178c-1786-43e6-ad79-e4e1bdafd441 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:01.448472 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-abeb178c-1786-43e6-ad79-e4e1bdafd441 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1513 microversion: 2.1 time: 0.151397 Oct 28 12:19:01.449036 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 483/984] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:01 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:19:02.156398 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4fd555f2-b435-4d41-a91c-d387cb71e84c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:02.157407 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4fd555f2-b435-4d41-a91c-d387cb71e84c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:02.163449 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fd555f2-b435-4d41-a91c-d387cb71e84c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:02.163886 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fd555f2-b435-4d41-a91c-d387cb71e84c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:02.164659 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fd555f2-b435-4d41-a91c-d387cb71e84c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:02.165082 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fd555f2-b435-4d41-a91c-d387cb71e84c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:02.284084 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4fd555f2-b435-4d41-a91c-d387cb71e84c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.131932 Oct 28 12:19:02.284750 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 502/985] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:02 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:02.344110 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2c2eeafd-43c4-411b-8378-a38363530dfb tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:02.344732 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2c2eeafd-43c4-411b-8378-a38363530dfb tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:02.351034 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c2eeafd-43c4-411b-8378-a38363530dfb tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:02.351483 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c2eeafd-43c4-411b-8378-a38363530dfb tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:02.352226 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c2eeafd-43c4-411b-8378-a38363530dfb tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:02.352647 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c2eeafd-43c4-411b-8378-a38363530dfb tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:02.465529 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-72615f85-16db-41fa-a4c8-32fbdeeada11 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:02.466218 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-72615f85-16db-41fa-a4c8-32fbdeeada11 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:02.472949 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72615f85-16db-41fa-a4c8-32fbdeeada11 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:02.473391 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72615f85-16db-41fa-a4c8-32fbdeeada11 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:02.474177 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72615f85-16db-41fa-a4c8-32fbdeeada11 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:02.474606 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72615f85-16db-41fa-a4c8-32fbdeeada11 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:02.479313 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2c2eeafd-43c4-411b-8378-a38363530dfb tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:02.487516 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2c2eeafd-43c4-411b-8378-a38363530dfb tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1314 microversion: 2.1 time: 0.147082 Oct 28 12:19:02.488208 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 484/986] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:02 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:19:02.895504 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-72615f85-16db-41fa-a4c8-32fbdeeada11 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3b17d1ff60414d898fa16aca182c1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8940dc0094a47d1a152788282bedb0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:02.903293 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-72615f85-16db-41fa-a4c8-32fbdeeada11 tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 200 len: 1513 microversion: 2.1 time: 0.441665 Oct 28 12:19:02.903860 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 503/987] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:02 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 1513 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:19:03.296104 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-355ad97c-1098-4ade-bd5f-7075f6de44d6 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:03.297007 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-355ad97c-1098-4ade-bd5f-7075f6de44d6 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:03.303781 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-355ad97c-1098-4ade-bd5f-7075f6de44d6 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:03.304171 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-355ad97c-1098-4ade-bd5f-7075f6de44d6 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:03.304939 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-355ad97c-1098-4ade-bd5f-7075f6de44d6 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:03.305376 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-355ad97c-1098-4ade-bd5f-7075f6de44d6 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:03.368422 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-355ad97c-1098-4ade-bd5f-7075f6de44d6 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.076157 Oct 28 12:19:03.369096 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 485/988] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:03 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:03.409351 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-5c1b88eb-9972-4306-a5f7-6239f6d69101 req-89a14117-ae1f-4ffd-906d-7386ac11c39d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea6bc04f-095b-4b34-a107-3dbbd1d776fe", "name": "network-vif-deleted", "tag": "cd823aea-fe57-404d-8292-19c6622c9992"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:03.410912 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:19:03.410912 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:19:03.418648 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-5c1b88eb-9972-4306-a5f7-6239f6d69101 req-89a14117-ae1f-4ffd-906d-7386ac11c39d service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:03.419173 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-5c1b88eb-9972-4306-a5f7-6239f6d69101 req-89a14117-ae1f-4ffd-906d-7386ac11c39d service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:03.429035 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-5c1b88eb-9972-4306-a5f7-6239f6d69101 req-89a14117-ae1f-4ffd-906d-7386ac11c39d service nova] Creating event network-vif-deleted:cd823aea-fe57-404d-8292-19c6622c9992 for instance ea6bc04f-095b-4b34-a107-3dbbd1d776fe on hv-cinder-81571 Oct 28 12:19:03.433672 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-5c1b88eb-9972-4306-a5f7-6239f6d69101 req-89a14117-ae1f-4ffd-906d-7386ac11c39d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028513 Oct 28 12:19:03.434229 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 504/989] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:19:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:19:03.504513 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b7148b45-58f0-400a-9981-6991d58e0d55 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:03.505206 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b7148b45-58f0-400a-9981-6991d58e0d55 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:03.511983 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b7148b45-58f0-400a-9981-6991d58e0d55 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:03.512426 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b7148b45-58f0-400a-9981-6991d58e0d55 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:03.513194 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b7148b45-58f0-400a-9981-6991d58e0d55 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:03.513628 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b7148b45-58f0-400a-9981-6991d58e0d55 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:03.646659 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b7148b45-58f0-400a-9981-6991d58e0d55 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:03.654119 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b7148b45-58f0-400a-9981-6991d58e0d55 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1314 microversion: 2.1 time: 0.153353 Oct 28 12:19:03.654498 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 486/990] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:03 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:19:03.921596 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3ee8e2c7-ea3a-40ee-a879-566265e74c4e tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:03.922272 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3ee8e2c7-ea3a-40ee-a879-566265e74c4e tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] [instance: ea6bc04f-095b-4b34-a107-3dbbd1d776fe] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:03.928744 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3ee8e2c7-ea3a-40ee-a879-566265e74c4e tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:03.929178 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3ee8e2c7-ea3a-40ee-a879-566265e74c4e tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:03.929931 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3ee8e2c7-ea3a-40ee-a879-566265e74c4e tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:03.930347 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3ee8e2c7-ea3a-40ee-a879-566265e74c4e tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:03.943416 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-3ee8e2c7-ea3a-40ee-a879-566265e74c4e tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] HTTP exception thrown: Instance ea6bc04f-095b-4b34-a107-3dbbd1d776fe could not be found. Oct 28 12:19:03.944006 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3ee8e2c7-ea3a-40ee-a879-566265e74c4e tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] Returning 404 to user: Instance ea6bc04f-095b-4b34-a107-3dbbd1d776fe could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:19:03.944796 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3ee8e2c7-ea3a-40ee-a879-566265e74c4e tempest-VolumesSnapshotTestJSON-290409953 tempest-VolumesSnapshotTestJSON-290409953-project] 10.222.0.37 "GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe" status: 404 len: 111 microversion: 2.1 time: 0.027501 Oct 28 12:19:03.945302 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 505/991] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:03 2021] GET /compute/v2.1/servers/ea6bc04f-095b-4b34-a107-3dbbd1d776fe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:19:04.382260 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ae7fd58f-a568-42b9-9a65-2bde6ac19e2a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:04.383198 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ae7fd58f-a568-42b9-9a65-2bde6ac19e2a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:04.389399 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ae7fd58f-a568-42b9-9a65-2bde6ac19e2a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:04.389842 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ae7fd58f-a568-42b9-9a65-2bde6ac19e2a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:04.390603 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ae7fd58f-a568-42b9-9a65-2bde6ac19e2a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:04.391059 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ae7fd58f-a568-42b9-9a65-2bde6ac19e2a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:04.457472 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ae7fd58f-a568-42b9-9a65-2bde6ac19e2a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.080323 Oct 28 12:19:04.459812 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 487/992] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:04 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:19:04.669620 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4f778412-bde9-4d8c-8ae9-1a38e6801acb tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:04.670430 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4f778412-bde9-4d8c-8ae9-1a38e6801acb tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:04.676778 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4f778412-bde9-4d8c-8ae9-1a38e6801acb tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:04.677217 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4f778412-bde9-4d8c-8ae9-1a38e6801acb tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:04.677975 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4f778412-bde9-4d8c-8ae9-1a38e6801acb tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:04.678512 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4f778412-bde9-4d8c-8ae9-1a38e6801acb tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:04.798314 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4f778412-bde9-4d8c-8ae9-1a38e6801acb tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:04.805626 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4f778412-bde9-4d8c-8ae9-1a38e6801acb tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1314 microversion: 2.1 time: 0.139762 Oct 28 12:19:04.806181 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 506/993] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:04 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1314 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:19:05.470732 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-36209a38-d809-4346-8c97-faf49a926489 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:05.471685 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-36209a38-d809-4346-8c97-faf49a926489 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:05.480211 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-36209a38-d809-4346-8c97-faf49a926489 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:05.480652 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-36209a38-d809-4346-8c97-faf49a926489 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:05.481414 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-36209a38-d809-4346-8c97-faf49a926489 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:05.481843 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-36209a38-d809-4346-8c97-faf49a926489 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:05.543389 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-36209a38-d809-4346-8c97-faf49a926489 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.076540 Oct 28 12:19:05.544009 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 488/994] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:05 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:05.822432 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-30dbfad6-51be-4f22-8021-c28ec3320e54 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:05.823052 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-30dbfad6-51be-4f22-8021-c28ec3320e54 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:05.829321 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-30dbfad6-51be-4f22-8021-c28ec3320e54 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:05.829766 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-30dbfad6-51be-4f22-8021-c28ec3320e54 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:05.830536 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-30dbfad6-51be-4f22-8021-c28ec3320e54 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:05.831015 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-30dbfad6-51be-4f22-8021-c28ec3320e54 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:05.954923 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-30dbfad6-51be-4f22-8021-c28ec3320e54 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:05.962137 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-30dbfad6-51be-4f22-8021-c28ec3320e54 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1314 microversion: 2.1 time: 0.143470 Oct 28 12:19:05.962915 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 507/995] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:05 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:19:06.555916 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c7bf2d13-abf3-4cd6-ae4d-1d0b3a1442da tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:06.556911 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c7bf2d13-abf3-4cd6-ae4d-1d0b3a1442da tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:06.563704 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7bf2d13-abf3-4cd6-ae4d-1d0b3a1442da tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:06.564152 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7bf2d13-abf3-4cd6-ae4d-1d0b3a1442da tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:06.564954 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7bf2d13-abf3-4cd6-ae4d-1d0b3a1442da tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:06.565389 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7bf2d13-abf3-4cd6-ae4d-1d0b3a1442da tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:06.979218 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2fe44b1c-c0d3-47ca-9b46-6e46e8a5fc12 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:06.979845 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2fe44b1c-c0d3-47ca-9b46-6e46e8a5fc12 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:06.986661 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2fe44b1c-c0d3-47ca-9b46-6e46e8a5fc12 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:06.987131 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2fe44b1c-c0d3-47ca-9b46-6e46e8a5fc12 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:06.987893 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2fe44b1c-c0d3-47ca-9b46-6e46e8a5fc12 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:06.988391 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2fe44b1c-c0d3-47ca-9b46-6e46e8a5fc12 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:07.106569 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2fe44b1c-c0d3-47ca-9b46-6e46e8a5fc12 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:07.114177 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2fe44b1c-c0d3-47ca-9b46-6e46e8a5fc12 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1314 microversion: 2.1 time: 0.138618 Oct 28 12:19:07.114760 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 508/996] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:06 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1314 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:19:08.130950 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4417d8e8-f9f6-4b80-8580-63b97fbe0559 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:08.131588 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4417d8e8-f9f6-4b80-8580-63b97fbe0559 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:08.137739 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4417d8e8-f9f6-4b80-8580-63b97fbe0559 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:08.138176 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4417d8e8-f9f6-4b80-8580-63b97fbe0559 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:08.138948 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4417d8e8-f9f6-4b80-8580-63b97fbe0559 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:08.140122 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4417d8e8-f9f6-4b80-8580-63b97fbe0559 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:08.260052 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4417d8e8-f9f6-4b80-8580-63b97fbe0559 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:08.267831 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4417d8e8-f9f6-4b80-8580-63b97fbe0559 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1314 microversion: 2.1 time: 0.140759 Oct 28 12:19:08.268392 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 509/997] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:08 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:19:09.284942 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-491eaec4-99d0-4711-970b-b660e1c6a602 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:09.285598 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-491eaec4-99d0-4711-970b-b660e1c6a602 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:09.291759 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-491eaec4-99d0-4711-970b-b660e1c6a602 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:09.292195 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-491eaec4-99d0-4711-970b-b660e1c6a602 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:09.292953 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-491eaec4-99d0-4711-970b-b660e1c6a602 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:09.293379 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-491eaec4-99d0-4711-970b-b660e1c6a602 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:09.415956 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-491eaec4-99d0-4711-970b-b660e1c6a602 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:09.423390 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-491eaec4-99d0-4711-970b-b660e1c6a602 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1314 microversion: 2.1 time: 0.142115 Oct 28 12:19:09.423952 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 510/998] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:09 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:19:09.939380 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c7bf2d13-abf3-4cd6-ae4d-1d0b3a1442da tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 3.387226 Oct 28 12:19:09.940775 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 489/999] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:06 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 3389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:10.439822 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6d6826c6-b6d8-4e9a-a97e-db5488f66080 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:10.440542 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6d6826c6-b6d8-4e9a-a97e-db5488f66080 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:10.446840 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6d6826c6-b6d8-4e9a-a97e-db5488f66080 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:10.447250 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6d6826c6-b6d8-4e9a-a97e-db5488f66080 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:10.448020 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6d6826c6-b6d8-4e9a-a97e-db5488f66080 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:10.448456 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6d6826c6-b6d8-4e9a-a97e-db5488f66080 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:10.585951 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6d6826c6-b6d8-4e9a-a97e-db5488f66080 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:10.593778 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6d6826c6-b6d8-4e9a-a97e-db5488f66080 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1314 microversion: 2.1 time: 0.157610 Oct 28 12:19:10.598728 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 511/1000] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:10 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:19:10.951598 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-490cdd73-835a-484c-b638-9bac2cfc6a4d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:10.953056 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-490cdd73-835a-484c-b638-9bac2cfc6a4d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:10.960461 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-490cdd73-835a-484c-b638-9bac2cfc6a4d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:10.960907 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-490cdd73-835a-484c-b638-9bac2cfc6a4d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:10.961671 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-490cdd73-835a-484c-b638-9bac2cfc6a4d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:10.962102 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-490cdd73-835a-484c-b638-9bac2cfc6a4d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:11.040836 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-490cdd73-835a-484c-b638-9bac2cfc6a4d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.093211 Oct 28 12:19:11.041760 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 490/1001] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:10 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:11.611581 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-badca02e-fd1e-4199-9844-234b5a9ce6a1 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:11.612182 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-badca02e-fd1e-4199-9844-234b5a9ce6a1 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:11.618564 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-badca02e-fd1e-4199-9844-234b5a9ce6a1 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:11.619042 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-badca02e-fd1e-4199-9844-234b5a9ce6a1 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:11.619839 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-badca02e-fd1e-4199-9844-234b5a9ce6a1 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:11.620262 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-badca02e-fd1e-4199-9844-234b5a9ce6a1 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:11.738189 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-badca02e-fd1e-4199-9844-234b5a9ce6a1 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:11.746365 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-badca02e-fd1e-4199-9844-234b5a9ce6a1 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1314 microversion: 2.1 time: 0.138880 Oct 28 12:19:11.746990 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 512/1002] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:11 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1314 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:19:11.913670 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-f39983a9-1aa0-4447-b010-5415537afc0f req-ff203569-7203-40f9-a7c0-6457a3343cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae38635-e55c-40f1-824f-bfba6f254390", "name": "network-vif-plugged", "status": "completed", "tag": "457e28ae-6a99-4a85-93df-a34245f9b7a5"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:11.915315 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:19:11.915315 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:19:11.925405 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-f39983a9-1aa0-4447-b010-5415537afc0f req-ff203569-7203-40f9-a7c0-6457a3343cc6 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:11.925877 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-f39983a9-1aa0-4447-b010-5415537afc0f req-ff203569-7203-40f9-a7c0-6457a3343cc6 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:11.938454 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-f39983a9-1aa0-4447-b010-5415537afc0f req-ff203569-7203-40f9-a7c0-6457a3343cc6 service nova] Creating event network-vif-plugged:457e28ae-6a99-4a85-93df-a34245f9b7a5 for instance 5ae38635-e55c-40f1-824f-bfba6f254390 on hv-cinder-81571 Oct 28 12:19:11.944045 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-f39983a9-1aa0-4447-b010-5415537afc0f req-ff203569-7203-40f9-a7c0-6457a3343cc6 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034233 Oct 28 12:19:11.944650 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 491/1003] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:19:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:19:12.052855 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9cf68496-5074-4a4c-99ca-240737b8f28c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:12.053791 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9cf68496-5074-4a4c-99ca-240737b8f28c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:12.060021 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9cf68496-5074-4a4c-99ca-240737b8f28c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:12.060463 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9cf68496-5074-4a4c-99ca-240737b8f28c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:12.061341 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9cf68496-5074-4a4c-99ca-240737b8f28c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:12.061770 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9cf68496-5074-4a4c-99ca-240737b8f28c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:12.145839 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9cf68496-5074-4a4c-99ca-240737b8f28c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.096565 Oct 28 12:19:12.147916 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 513/1004] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:12 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:12.763334 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-17c97ec7-58b5-4771-a477-ac1f56cfe60c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:12.764014 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-17c97ec7-58b5-4771-a477-ac1f56cfe60c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:12.771165 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-17c97ec7-58b5-4771-a477-ac1f56cfe60c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:12.771599 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-17c97ec7-58b5-4771-a477-ac1f56cfe60c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:12.772355 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-17c97ec7-58b5-4771-a477-ac1f56cfe60c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:12.772777 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-17c97ec7-58b5-4771-a477-ac1f56cfe60c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:12.892273 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-17c97ec7-58b5-4771-a477-ac1f56cfe60c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:12.899567 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-17c97ec7-58b5-4771-a477-ac1f56cfe60c tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1314 microversion: 2.1 time: 0.140201 Oct 28 12:19:12.900128 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 492/1005] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:12 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:19:13.158388 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-70c31f24-1eab-4e5c-a168-8a7a53ca1597 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:13.159452 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-70c31f24-1eab-4e5c-a168-8a7a53ca1597 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:13.167558 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70c31f24-1eab-4e5c-a168-8a7a53ca1597 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:13.168038 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70c31f24-1eab-4e5c-a168-8a7a53ca1597 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:13.168908 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70c31f24-1eab-4e5c-a168-8a7a53ca1597 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:13.169333 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70c31f24-1eab-4e5c-a168-8a7a53ca1597 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:13.235480 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-70c31f24-1eab-4e5c-a168-8a7a53ca1597 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.081168 Oct 28 12:19:13.236128 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 514/1006] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:13 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:13.916098 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-db1de58d-2603-4f22-97a4-7fa013984c7a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:13.916703 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-db1de58d-2603-4f22-97a4-7fa013984c7a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:13.923316 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db1de58d-2603-4f22-97a4-7fa013984c7a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:13.923761 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db1de58d-2603-4f22-97a4-7fa013984c7a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:13.924529 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db1de58d-2603-4f22-97a4-7fa013984c7a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:13.924962 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db1de58d-2603-4f22-97a4-7fa013984c7a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:14.048634 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-db1de58d-2603-4f22-97a4-7fa013984c7a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:14.055939 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-db1de58d-2603-4f22-97a4-7fa013984c7a tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1498 microversion: 2.1 time: 0.143563 Oct 28 12:19:14.056505 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 493/1007] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:13 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1498 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:19:14.247596 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-19ce8582-851b-48c3-9803-07f58e2ab2e8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:14.249145 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-19ce8582-851b-48c3-9803-07f58e2ab2e8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:14.256028 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-19ce8582-851b-48c3-9803-07f58e2ab2e8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:14.256479 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-19ce8582-851b-48c3-9803-07f58e2ab2e8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:14.257251 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-19ce8582-851b-48c3-9803-07f58e2ab2e8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:14.257686 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-19ce8582-851b-48c3-9803-07f58e2ab2e8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:14.324614 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-19ce8582-851b-48c3-9803-07f58e2ab2e8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.080876 Oct 28 12:19:14.326132 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 515/1008] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:14 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:14.486421 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-21cca70c-f171-4b08-b3bb-3d8ea3c95aa7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:14.487034 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-21cca70c-f171-4b08-b3bb-3d8ea3c95aa7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:14.493607 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-21cca70c-f171-4b08-b3bb-3d8ea3c95aa7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:14.494044 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-21cca70c-f171-4b08-b3bb-3d8ea3c95aa7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:14.494845 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-21cca70c-f171-4b08-b3bb-3d8ea3c95aa7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:14.495266 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-21cca70c-f171-4b08-b3bb-3d8ea3c95aa7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:14.520951 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-21cca70c-f171-4b08-b3bb-3d8ea3c95aa7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:19:14.593453 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-21cca70c-f171-4b08-b3bb-3d8ea3c95aa7 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "DELETE /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 204 len: 0 microversion: 2.1 time: 0.110895 Oct 28 12:19:14.594211 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 494/1009] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:19:14 2021] DELETE /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:19:14.602764 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cc42e94a-500e-4cbd-af07-e8f21ea15e7f tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:14.603462 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cc42e94a-500e-4cbd-af07-e8f21ea15e7f tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:14.610869 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cc42e94a-500e-4cbd-af07-e8f21ea15e7f tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:14.611316 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cc42e94a-500e-4cbd-af07-e8f21ea15e7f tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:14.612083 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cc42e94a-500e-4cbd-af07-e8f21ea15e7f tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:14.612509 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cc42e94a-500e-4cbd-af07-e8f21ea15e7f tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:14.731251 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-cc42e94a-500e-4cbd-af07-e8f21ea15e7f tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:14.739015 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cc42e94a-500e-4cbd-af07-e8f21ea15e7f tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1504 microversion: 2.1 time: 0.140352 Oct 28 12:19:14.739572 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 516/1010] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:14 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1504 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:19:15.337554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ab2d0976-843e-4d6c-b255-c24e5233cc0b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:15.338593 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ab2d0976-843e-4d6c-b255-c24e5233cc0b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:15.345395 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ab2d0976-843e-4d6c-b255-c24e5233cc0b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:15.345840 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ab2d0976-843e-4d6c-b255-c24e5233cc0b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:15.346608 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ab2d0976-843e-4d6c-b255-c24e5233cc0b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:15.347065 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ab2d0976-843e-4d6c-b255-c24e5233cc0b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:15.755752 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-80e5a5f6-9088-44b3-a16d-aee6706a932f tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:15.756393 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-80e5a5f6-9088-44b3-a16d-aee6706a932f tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:15.763020 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-80e5a5f6-9088-44b3-a16d-aee6706a932f tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:15.763470 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-80e5a5f6-9088-44b3-a16d-aee6706a932f tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:15.764872 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-80e5a5f6-9088-44b3-a16d-aee6706a932f tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:15.765301 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-80e5a5f6-9088-44b3-a16d-aee6706a932f tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:15.883875 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-80e5a5f6-9088-44b3-a16d-aee6706a932f tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:15.891725 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-80e5a5f6-9088-44b3-a16d-aee6706a932f tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1504 microversion: 2.1 time: 0.139596 Oct 28 12:19:15.892282 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 517/1011] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:15 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1504 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:19:16.908980 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cbcb0b61-37a2-4589-b143-3a1ba55a6eb0 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:16.909617 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cbcb0b61-37a2-4589-b143-3a1ba55a6eb0 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:16.915793 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cbcb0b61-37a2-4589-b143-3a1ba55a6eb0 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:16.916235 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cbcb0b61-37a2-4589-b143-3a1ba55a6eb0 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:16.916991 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cbcb0b61-37a2-4589-b143-3a1ba55a6eb0 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:16.917415 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cbcb0b61-37a2-4589-b143-3a1ba55a6eb0 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:17.040811 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-cbcb0b61-37a2-4589-b143-3a1ba55a6eb0 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:17.048228 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cbcb0b61-37a2-4589-b143-3a1ba55a6eb0 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1504 microversion: 2.1 time: 0.143591 Oct 28 12:19:17.048787 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 518/1012] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:16 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1504 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:19:17.857343 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ab2d0976-843e-4d6c-b255-c24e5233cc0b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 2.523543 Oct 28 12:19:17.857926 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 495/1013] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:15 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 2525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:18.065290 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fb19f6eb-35b3-4dd4-8ec1-6baa95900f35 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:18.065871 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fb19f6eb-35b3-4dd4-8ec1-6baa95900f35 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:18.072081 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fb19f6eb-35b3-4dd4-8ec1-6baa95900f35 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:18.072525 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fb19f6eb-35b3-4dd4-8ec1-6baa95900f35 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:18.073279 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fb19f6eb-35b3-4dd4-8ec1-6baa95900f35 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:18.073706 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fb19f6eb-35b3-4dd4-8ec1-6baa95900f35 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:18.190842 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fb19f6eb-35b3-4dd4-8ec1-6baa95900f35 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:18.198002 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fb19f6eb-35b3-4dd4-8ec1-6baa95900f35 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1504 microversion: 2.1 time: 0.136955 Oct 28 12:19:18.198561 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 519/1014] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:18 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1504 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:19:18.869738 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fdbeac8c-c8a2-43e4-ad45-6bff2c84ceca tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:18.870723 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fdbeac8c-c8a2-43e4-ad45-6bff2c84ceca tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:18.877472 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fdbeac8c-c8a2-43e4-ad45-6bff2c84ceca tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:18.877912 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fdbeac8c-c8a2-43e4-ad45-6bff2c84ceca tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:18.878791 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fdbeac8c-c8a2-43e4-ad45-6bff2c84ceca tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:18.879241 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fdbeac8c-c8a2-43e4-ad45-6bff2c84ceca tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:19.215828 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7ad5015f-772f-4f27-af76-bfb202629843 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:19.216427 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7ad5015f-772f-4f27-af76-bfb202629843 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:19.223624 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ad5015f-772f-4f27-af76-bfb202629843 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:19.224071 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ad5015f-772f-4f27-af76-bfb202629843 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:19.224837 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ad5015f-772f-4f27-af76-bfb202629843 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:19.225266 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7ad5015f-772f-4f27-af76-bfb202629843 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:19.334229 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fdbeac8c-c8a2-43e4-ad45-6bff2c84ceca tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.468396 Oct 28 12:19:19.335044 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 496/1015] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:18 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:19.346216 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7ad5015f-772f-4f27-af76-bfb202629843 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:19.353498 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7ad5015f-772f-4f27-af76-bfb202629843 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1504 microversion: 2.1 time: 0.141326 Oct 28 12:19:19.354056 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 520/1016] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:19 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1504 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:19:20.346349 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c4cba8d0-f4e9-4634-99dd-e9b31c5a7a33 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:20.347370 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c4cba8d0-f4e9-4634-99dd-e9b31c5a7a33 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:20.354090 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4cba8d0-f4e9-4634-99dd-e9b31c5a7a33 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:20.354537 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4cba8d0-f4e9-4634-99dd-e9b31c5a7a33 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:20.355343 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4cba8d0-f4e9-4634-99dd-e9b31c5a7a33 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:20.355779 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c4cba8d0-f4e9-4634-99dd-e9b31c5a7a33 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:20.368909 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-49ad48c7-fead-496e-95fe-5e3919e21d8d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:20.369624 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-49ad48c7-fead-496e-95fe-5e3919e21d8d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:20.376001 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-49ad48c7-fead-496e-95fe-5e3919e21d8d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:20.376440 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-49ad48c7-fead-496e-95fe-5e3919e21d8d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:20.377352 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-49ad48c7-fead-496e-95fe-5e3919e21d8d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:20.377776 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-49ad48c7-fead-496e-95fe-5e3919e21d8d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:20.453512 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c4cba8d0-f4e9-4634-99dd-e9b31c5a7a33 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.111514 Oct 28 12:19:20.456634 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 497/1017] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:20 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:20.499123 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-49ad48c7-fead-496e-95fe-5e3919e21d8d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d5416fdd41f47f88f05148c94b7af74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2307f41d09814947a921545ae8b32a1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:19:20.506267 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-49ad48c7-fead-496e-95fe-5e3919e21d8d tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 200 len: 1504 microversion: 2.1 time: 0.140988 Oct 28 12:19:20.506915 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 521/1018] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:20 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 1504 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:19:20.993487 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-93db12d6-78a8-4642-b8da-7184b4384d37 req-e1c2db7a-89f8-4e4a-8301-a73c8c1e8e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae38635-e55c-40f1-824f-bfba6f254390", "name": "network-vif-deleted", "tag": "457e28ae-6a99-4a85-93df-a34245f9b7a5"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:20.995040 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:19:20.995040 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:19:21.003799 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-93db12d6-78a8-4642-b8da-7184b4384d37 req-e1c2db7a-89f8-4e4a-8301-a73c8c1e8e92 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:21.004249 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-93db12d6-78a8-4642-b8da-7184b4384d37 req-e1c2db7a-89f8-4e4a-8301-a73c8c1e8e92 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:21.016157 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-93db12d6-78a8-4642-b8da-7184b4384d37 req-e1c2db7a-89f8-4e4a-8301-a73c8c1e8e92 service nova] Creating event network-vif-deleted:457e28ae-6a99-4a85-93df-a34245f9b7a5 for instance 5ae38635-e55c-40f1-824f-bfba6f254390 on hv-cinder-81571 Oct 28 12:19:21.021035 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-93db12d6-78a8-4642-b8da-7184b4384d37 req-e1c2db7a-89f8-4e4a-8301-a73c8c1e8e92 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031567 Oct 28 12:19:21.021631 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 498/1019] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:19:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:19:21.465202 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dccec89f-f1c5-48b8-ba33-277580b9a184 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:21.466121 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dccec89f-f1c5-48b8-ba33-277580b9a184 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:21.472343 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dccec89f-f1c5-48b8-ba33-277580b9a184 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:21.472778 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dccec89f-f1c5-48b8-ba33-277580b9a184 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:21.473623 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dccec89f-f1c5-48b8-ba33-277580b9a184 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:21.474044 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dccec89f-f1c5-48b8-ba33-277580b9a184 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:21.524793 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7c423c56-10d9-4495-891f-d4c494ca51e6 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:21.525534 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7c423c56-10d9-4495-891f-d4c494ca51e6 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] [instance: 5ae38635-e55c-40f1-824f-bfba6f254390] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:21.531654 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7c423c56-10d9-4495-891f-d4c494ca51e6 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:21.532361 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7c423c56-10d9-4495-891f-d4c494ca51e6 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:21.533128 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7c423c56-10d9-4495-891f-d4c494ca51e6 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:21.533551 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7c423c56-10d9-4495-891f-d4c494ca51e6 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:21.539977 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dccec89f-f1c5-48b8-ba33-277580b9a184 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.078238 Oct 28 12:19:21.544902 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 522/1020] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:21 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:21.547915 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-7c423c56-10d9-4495-891f-d4c494ca51e6 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] HTTP exception thrown: Instance 5ae38635-e55c-40f1-824f-bfba6f254390 could not be found. Oct 28 12:19:21.548710 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7c423c56-10d9-4495-891f-d4c494ca51e6 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] Returning 404 to user: Instance 5ae38635-e55c-40f1-824f-bfba6f254390 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:19:21.549529 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7c423c56-10d9-4495-891f-d4c494ca51e6 tempest-VolumesActionsTest-1904093713 tempest-VolumesActionsTest-1904093713-project] 10.222.0.37 "GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390" status: 404 len: 111 microversion: 2.1 time: 0.029275 Oct 28 12:19:21.550097 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 499/1021] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:19:21 2021] GET /compute/v2.1/servers/5ae38635-e55c-40f1-824f-bfba6f254390 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 12:19:22.552440 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3fc7f5f5-01c5-4f7a-bf38-937187ea9f6e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:22.553371 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3fc7f5f5-01c5-4f7a-bf38-937187ea9f6e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:22.560152 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3fc7f5f5-01c5-4f7a-bf38-937187ea9f6e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:22.561080 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3fc7f5f5-01c5-4f7a-bf38-937187ea9f6e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:22.561835 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3fc7f5f5-01c5-4f7a-bf38-937187ea9f6e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:22.562260 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3fc7f5f5-01c5-4f7a-bf38-937187ea9f6e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:24.541138 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3fc7f5f5-01c5-4f7a-bf38-937187ea9f6e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 1.992553 Oct 28 12:19:24.542436 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 523/1022] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:22 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:25.553113 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6cfe21d8-7e3d-454c-a792-762bc5d2e126 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:25.554011 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6cfe21d8-7e3d-454c-a792-762bc5d2e126 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:25.560220 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6cfe21d8-7e3d-454c-a792-762bc5d2e126 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:25.560659 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6cfe21d8-7e3d-454c-a792-762bc5d2e126 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:25.561420 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6cfe21d8-7e3d-454c-a792-762bc5d2e126 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:25.561850 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6cfe21d8-7e3d-454c-a792-762bc5d2e126 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:27.036784 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6cfe21d8-7e3d-454c-a792-762bc5d2e126 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 1.487119 Oct 28 12:19:27.037419 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 500/1023] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:25 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:28.048688 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4fba3f5d-d041-4154-945b-d0ecb75e7357 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:28.049672 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4fba3f5d-d041-4154-945b-d0ecb75e7357 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:28.057124 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fba3f5d-d041-4154-945b-d0ecb75e7357 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:28.057567 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fba3f5d-d041-4154-945b-d0ecb75e7357 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:28.058332 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fba3f5d-d041-4154-945b-d0ecb75e7357 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:28.058813 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fba3f5d-d041-4154-945b-d0ecb75e7357 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:28.117354 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4fba3f5d-d041-4154-945b-d0ecb75e7357 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.073331 Oct 28 12:19:28.118057 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 524/1024] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:28 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:29.129279 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e30a8f76-8d97-4497-a189-d76b626a63c5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:29.130274 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e30a8f76-8d97-4497-a189-d76b626a63c5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:29.137039 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e30a8f76-8d97-4497-a189-d76b626a63c5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:29.137483 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e30a8f76-8d97-4497-a189-d76b626a63c5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:29.138245 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e30a8f76-8d97-4497-a189-d76b626a63c5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:29.138701 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e30a8f76-8d97-4497-a189-d76b626a63c5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:29.213933 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e30a8f76-8d97-4497-a189-d76b626a63c5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.088507 Oct 28 12:19:29.218427 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 501/1025] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:29 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:30.225729 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-58bf040c-74d0-4be6-b373-2aa23041b7cc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:30.227377 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-58bf040c-74d0-4be6-b373-2aa23041b7cc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:30.235798 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58bf040c-74d0-4be6-b373-2aa23041b7cc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:30.236555 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58bf040c-74d0-4be6-b373-2aa23041b7cc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:30.237706 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58bf040c-74d0-4be6-b373-2aa23041b7cc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:30.238371 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-58bf040c-74d0-4be6-b373-2aa23041b7cc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:30.303294 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-58bf040c-74d0-4be6-b373-2aa23041b7cc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.081331 Oct 28 12:19:30.304287 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 525/1026] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:30 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:31.316150 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0f1bb17a-bb26-40d1-afa7-fcfeda3239be tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:31.317219 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0f1bb17a-bb26-40d1-afa7-fcfeda3239be tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:31.324138 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0f1bb17a-bb26-40d1-afa7-fcfeda3239be tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:31.324581 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0f1bb17a-bb26-40d1-afa7-fcfeda3239be tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:31.325350 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0f1bb17a-bb26-40d1-afa7-fcfeda3239be tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:31.326669 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0f1bb17a-bb26-40d1-afa7-fcfeda3239be tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:31.389190 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0f1bb17a-bb26-40d1-afa7-fcfeda3239be tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.076435 Oct 28 12:19:31.390094 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 502/1027] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:31 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:32.401813 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e2cfda56-773d-416d-9ee3-96df668bcebd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:32.402847 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e2cfda56-773d-416d-9ee3-96df668bcebd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:32.410507 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e2cfda56-773d-416d-9ee3-96df668bcebd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:32.411244 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e2cfda56-773d-416d-9ee3-96df668bcebd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:32.412195 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e2cfda56-773d-416d-9ee3-96df668bcebd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:32.412699 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e2cfda56-773d-416d-9ee3-96df668bcebd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:32.487869 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e2cfda56-773d-416d-9ee3-96df668bcebd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.089668 Oct 28 12:19:32.489394 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 526/1028] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:32 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:33.502412 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-87e4d688-5d35-4bad-bd4d-618046a40278 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:33.504014 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-87e4d688-5d35-4bad-bd4d-618046a40278 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:33.511496 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-87e4d688-5d35-4bad-bd4d-618046a40278 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:33.512300 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-87e4d688-5d35-4bad-bd4d-618046a40278 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:33.513596 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-87e4d688-5d35-4bad-bd4d-618046a40278 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:33.514099 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-87e4d688-5d35-4bad-bd4d-618046a40278 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:33.585777 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-87e4d688-5d35-4bad-bd4d-618046a40278 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.089025 Oct 28 12:19:33.586866 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 503/1029] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:33 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:34.598003 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ea5e74c9-5147-44fc-9a75-778e616c3fbd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:34.601258 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ea5e74c9-5147-44fc-9a75-778e616c3fbd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:34.608826 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ea5e74c9-5147-44fc-9a75-778e616c3fbd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:34.609793 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ea5e74c9-5147-44fc-9a75-778e616c3fbd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:34.611188 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ea5e74c9-5147-44fc-9a75-778e616c3fbd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:34.611965 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ea5e74c9-5147-44fc-9a75-778e616c3fbd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:34.681878 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ea5e74c9-5147-44fc-9a75-778e616c3fbd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.087677 Oct 28 12:19:34.687708 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 527/1030] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:34 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:35.699342 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7f3ec01b-cd42-43ca-97cf-c07d90cc1bc8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:35.701230 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7f3ec01b-cd42-43ca-97cf-c07d90cc1bc8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:35.710075 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7f3ec01b-cd42-43ca-97cf-c07d90cc1bc8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:35.710520 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7f3ec01b-cd42-43ca-97cf-c07d90cc1bc8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:35.711530 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7f3ec01b-cd42-43ca-97cf-c07d90cc1bc8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:35.712147 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7f3ec01b-cd42-43ca-97cf-c07d90cc1bc8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:35.787919 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7f3ec01b-cd42-43ca-97cf-c07d90cc1bc8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.096967 Oct 28 12:19:35.788563 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 504/1031] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:35 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:36.801608 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4fee4df5-bdc0-435d-bdf5-b17329f137c0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:36.803295 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4fee4df5-bdc0-435d-bdf5-b17329f137c0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:36.810584 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fee4df5-bdc0-435d-bdf5-b17329f137c0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:36.811004 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fee4df5-bdc0-435d-bdf5-b17329f137c0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:36.811908 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fee4df5-bdc0-435d-bdf5-b17329f137c0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:36.812347 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4fee4df5-bdc0-435d-bdf5-b17329f137c0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:36.880322 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4fee4df5-bdc0-435d-bdf5-b17329f137c0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28714 microversion: 2.1 time: 0.082495 Oct 28 12:19:36.881914 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 528/1032] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:36 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28714 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:37.897916 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f638eb4b-7143-4cac-baa4-16dea9137ce5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:37.899612 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f638eb4b-7143-4cac-baa4-16dea9137ce5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:37.914445 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f638eb4b-7143-4cac-baa4-16dea9137ce5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:37.915134 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f638eb4b-7143-4cac-baa4-16dea9137ce5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:37.915991 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f638eb4b-7143-4cac-baa4-16dea9137ce5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:37.916496 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f638eb4b-7143-4cac-baa4-16dea9137ce5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:38.009148 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f638eb4b-7143-4cac-baa4-16dea9137ce5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 28762 microversion: 2.1 time: 0.118641 Oct 28 12:19:38.010229 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 505/1033] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:37 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 28762 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:39.022285 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-20f76adc-2107-466f-a769-ab03e7f80ddb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:39.023350 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-20f76adc-2107-466f-a769-ab03e7f80ddb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:39.031241 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-20f76adc-2107-466f-a769-ab03e7f80ddb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:39.031693 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-20f76adc-2107-466f-a769-ab03e7f80ddb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:39.032499 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-20f76adc-2107-466f-a769-ab03e7f80ddb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:39.032933 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-20f76adc-2107-466f-a769-ab03e7f80ddb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:39.112918 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-20f76adc-2107-466f-a769-ab03e7f80ddb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 30701 microversion: 2.1 time: 0.094487 Oct 28 12:19:39.113507 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 529/1034] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:39 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 30701 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:19:40.125385 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-56d0a46a-ba91-43cb-a21c-c423abf2414f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:40.126414 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-56d0a46a-ba91-43cb-a21c-c423abf2414f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:40.133476 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-56d0a46a-ba91-43cb-a21c-c423abf2414f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:40.133923 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-56d0a46a-ba91-43cb-a21c-c423abf2414f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:40.134997 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-56d0a46a-ba91-43cb-a21c-c423abf2414f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:40.135674 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-56d0a46a-ba91-43cb-a21c-c423abf2414f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:40.209463 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-56d0a46a-ba91-43cb-a21c-c423abf2414f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 32535 microversion: 2.1 time: 0.088664 Oct 28 12:19:40.210322 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 506/1035] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:40 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 32535 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:41.223469 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cb1e8597-be22-42dc-9f96-f184cf7467bc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:41.225371 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cb1e8597-be22-42dc-9f96-f184cf7467bc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:41.232841 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb1e8597-be22-42dc-9f96-f184cf7467bc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:41.233726 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb1e8597-be22-42dc-9f96-f184cf7467bc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:41.234406 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb1e8597-be22-42dc-9f96-f184cf7467bc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:41.234867 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cb1e8597-be22-42dc-9f96-f184cf7467bc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:41.320662 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cb1e8597-be22-42dc-9f96-f184cf7467bc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 33470 microversion: 2.1 time: 0.101429 Oct 28 12:19:41.321702 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 530/1036] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:41 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 33470 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:42.332753 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e97a1d4f-449c-46ec-8b91-b011f86ce512 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:42.333729 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e97a1d4f-449c-46ec-8b91-b011f86ce512 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:42.341050 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e97a1d4f-449c-46ec-8b91-b011f86ce512 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:42.341810 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e97a1d4f-449c-46ec-8b91-b011f86ce512 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:42.342665 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e97a1d4f-449c-46ec-8b91-b011f86ce512 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:42.343185 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e97a1d4f-449c-46ec-8b91-b011f86ce512 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:42.417291 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e97a1d4f-449c-46ec-8b91-b011f86ce512 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 34536 microversion: 2.1 time: 0.088363 Oct 28 12:19:42.418282 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 507/1037] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:42 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 34536 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:43.430517 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1a3df136-759b-4b4f-b670-c00889bb29cb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:43.431553 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1a3df136-759b-4b4f-b670-c00889bb29cb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:43.439371 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1a3df136-759b-4b4f-b670-c00889bb29cb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:43.439818 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1a3df136-759b-4b4f-b670-c00889bb29cb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:43.440606 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1a3df136-759b-4b4f-b670-c00889bb29cb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:43.441038 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1a3df136-759b-4b4f-b670-c00889bb29cb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:43.517474 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1a3df136-759b-4b4f-b670-c00889bb29cb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 35481 microversion: 2.1 time: 0.090938 Oct 28 12:19:43.518238 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 531/1038] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:43 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 35481 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:44.530776 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a60e4b38-943e-4434-ad91-1ceb54edb34c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:44.531806 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a60e4b38-943e-4434-ad91-1ceb54edb34c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:44.538584 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a60e4b38-943e-4434-ad91-1ceb54edb34c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:44.539131 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a60e4b38-943e-4434-ad91-1ceb54edb34c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:44.539905 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a60e4b38-943e-4434-ad91-1ceb54edb34c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:44.540338 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a60e4b38-943e-4434-ad91-1ceb54edb34c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:44.621560 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a60e4b38-943e-4434-ad91-1ceb54edb34c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 36862 microversion: 2.1 time: 0.095397 Oct 28 12:19:44.622215 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 508/1039] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:44 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 36862 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:45.633709 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d997cd10-ad7c-424d-aa68-093b9a70d921 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:45.634713 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d997cd10-ad7c-424d-aa68-093b9a70d921 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:45.642120 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d997cd10-ad7c-424d-aa68-093b9a70d921 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:45.642561 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d997cd10-ad7c-424d-aa68-093b9a70d921 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:45.643359 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d997cd10-ad7c-424d-aa68-093b9a70d921 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:45.643788 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d997cd10-ad7c-424d-aa68-093b9a70d921 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:45.724193 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d997cd10-ad7c-424d-aa68-093b9a70d921 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 38247 microversion: 2.1 time: 0.094306 Oct 28 12:19:45.725106 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 532/1040] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:45 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 38247 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:46.737454 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9447fddf-6af8-43b4-8b6e-96dc6685470f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:46.738437 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9447fddf-6af8-43b4-8b6e-96dc6685470f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:46.745148 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9447fddf-6af8-43b4-8b6e-96dc6685470f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:46.745587 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9447fddf-6af8-43b4-8b6e-96dc6685470f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:46.746335 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9447fddf-6af8-43b4-8b6e-96dc6685470f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:46.746798 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9447fddf-6af8-43b4-8b6e-96dc6685470f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:46.808326 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9447fddf-6af8-43b4-8b6e-96dc6685470f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 38247 microversion: 2.1 time: 0.074691 Oct 28 12:19:46.808978 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 509/1041] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:46 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 38247 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:47.821957 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1309ecce-3d50-4858-98eb-c29da629b25b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:47.823270 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1309ecce-3d50-4858-98eb-c29da629b25b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:47.830907 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1309ecce-3d50-4858-98eb-c29da629b25b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:47.831358 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1309ecce-3d50-4858-98eb-c29da629b25b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:47.832150 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1309ecce-3d50-4858-98eb-c29da629b25b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:47.832579 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1309ecce-3d50-4858-98eb-c29da629b25b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:47.898702 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1309ecce-3d50-4858-98eb-c29da629b25b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 38247 microversion: 2.1 time: 0.080712 Oct 28 12:19:47.899468 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 533/1042] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:47 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 38247 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:48.911327 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e5662d3e-e2bc-48e2-8c08-2651e36e9bdb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:48.912337 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e5662d3e-e2bc-48e2-8c08-2651e36e9bdb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:48.919388 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e5662d3e-e2bc-48e2-8c08-2651e36e9bdb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:48.920083 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e5662d3e-e2bc-48e2-8c08-2651e36e9bdb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:48.920864 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e5662d3e-e2bc-48e2-8c08-2651e36e9bdb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:48.921296 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e5662d3e-e2bc-48e2-8c08-2651e36e9bdb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:48.994925 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e5662d3e-e2bc-48e2-8c08-2651e36e9bdb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 38247 microversion: 2.1 time: 0.087625 Oct 28 12:19:48.996422 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 510/1043] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:48 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 38247 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:50.008067 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3442199e-0bad-427a-880b-1b077694d6c7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:50.009058 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3442199e-0bad-427a-880b-1b077694d6c7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:50.015942 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3442199e-0bad-427a-880b-1b077694d6c7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:50.016389 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3442199e-0bad-427a-880b-1b077694d6c7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:50.017157 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3442199e-0bad-427a-880b-1b077694d6c7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:50.017586 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3442199e-0bad-427a-880b-1b077694d6c7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:50.091930 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3442199e-0bad-427a-880b-1b077694d6c7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 200 len: 38378 microversion: 2.1 time: 0.087344 Oct 28 12:19:50.092543 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 534/1044] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:19:50 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 38378 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:19:50.103022 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f9243cf3-0253-4ed9-ac11-f2d16f86465b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:19:50.103634 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f9243cf3-0253-4ed9-ac11-f2d16f86465b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:50.111119 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f9243cf3-0253-4ed9-ac11-f2d16f86465b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:50.111569 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f9243cf3-0253-4ed9-ac11-f2d16f86465b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:50.112335 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f9243cf3-0253-4ed9-ac11-f2d16f86465b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:50.112777 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f9243cf3-0253-4ed9-ac11-f2d16f86465b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:50.135282 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f9243cf3-0253-4ed9-ac11-f2d16f86465b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/ips" status: 200 len: 146 microversion: 2.1 time: 0.036328 Oct 28 12:19:50.135847 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 511/1045] 10.222.0.37 () {58 vars in 1247 bytes} [Thu Oct 28 12:19:50 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:19:56.839497 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-632c33db-d28f-4ff2-b71a-61d5f52ba922 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88f894a4-a535-4e65-b715-11b0e8f75cdb"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:19:56.840608 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-632c33db-d28f-4ff2-b71a-61d5f52ba922 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:19:56.848025 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-632c33db-d28f-4ff2-b71a-61d5f52ba922 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:56.848462 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-632c33db-d28f-4ff2-b71a-61d5f52ba922 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:56.849264 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-632c33db-d28f-4ff2-b71a-61d5f52ba922 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:19:56.849637 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-632c33db-d28f-4ff2-b71a-61d5f52ba922 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:19:57.070825 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-632c33db-d28f-4ff2-b71a-61d5f52ba922 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.235174 Oct 28 12:19:57.071474 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 535/1046] 10.222.0.37 () {60 vars in 1322 bytes} [Thu Oct 28 12:19:56 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/os-volume_attachments => generated 194 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:20:04.579532 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-06161585-0ca3-49c4-b7e0-15137ce4222c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:04.589585 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-06161585-0ca3-49c4-b7e0-15137ce4222c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:04.592117 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-06161585-0ca3-49c4-b7e0-15137ce4222c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:04.692765 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-06161585-0ca3-49c4-b7e0-15137ce4222c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Going to try to stop instance {{(pid=115797) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 28 12:20:04.765717 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-06161585-0ca3-49c4-b7e0-15137ce4222c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 202 len: 0 microversion: 2.1 time: 0.191460 Oct 28 12:20:04.769564 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 512/1047] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:20:04 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:20:04.775623 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1af570df-d9e4-4cff-bd96-80e82920974f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:04.776310 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1af570df-d9e4-4cff-bd96-80e82920974f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:04.786922 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1af570df-d9e4-4cff-bd96-80e82920974f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:04.787784 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1af570df-d9e4-4cff-bd96-80e82920974f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:04.788823 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1af570df-d9e4-4cff-bd96-80e82920974f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:04.795446 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1af570df-d9e4-4cff-bd96-80e82920974f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:05.028282 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1af570df-d9e4-4cff-bd96-80e82920974f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:05.040235 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1af570df-d9e4-4cff-bd96-80e82920974f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1720 microversion: 2.1 time: 0.269076 Oct 28 12:20:05.040987 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 536/1048] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:04 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1720 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:06.057961 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a3f5c570-fafb-4516-8bcd-2d310260fb26 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:06.059557 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a3f5c570-fafb-4516-8bcd-2d310260fb26 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:06.066358 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a3f5c570-fafb-4516-8bcd-2d310260fb26 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:06.066844 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a3f5c570-fafb-4516-8bcd-2d310260fb26 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:06.067642 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a3f5c570-fafb-4516-8bcd-2d310260fb26 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:06.068406 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a3f5c570-fafb-4516-8bcd-2d310260fb26 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:06.219530 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a3f5c570-fafb-4516-8bcd-2d310260fb26 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:06.229152 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a3f5c570-fafb-4516-8bcd-2d310260fb26 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1720 microversion: 2.1 time: 0.175272 Oct 28 12:20:06.230567 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 513/1049] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:06 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:07.246720 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-59e9dcf3-def1-4d1f-9d88-294b69209341 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:07.247241 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-59e9dcf3-def1-4d1f-9d88-294b69209341 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:07.253982 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59e9dcf3-def1-4d1f-9d88-294b69209341 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:07.254737 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59e9dcf3-def1-4d1f-9d88-294b69209341 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:07.255767 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59e9dcf3-def1-4d1f-9d88-294b69209341 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:07.256423 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59e9dcf3-def1-4d1f-9d88-294b69209341 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:07.431966 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-59e9dcf3-def1-4d1f-9d88-294b69209341 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:07.441117 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-59e9dcf3-def1-4d1f-9d88-294b69209341 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1720 microversion: 2.1 time: 0.198057 Oct 28 12:20:07.442129 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 537/1050] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:07 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1720 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:08.457654 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7aef0dd5-6734-4743-a7a2-53efaab46116 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:08.458373 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7aef0dd5-6734-4743-a7a2-53efaab46116 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:08.464548 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7aef0dd5-6734-4743-a7a2-53efaab46116 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:08.465141 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7aef0dd5-6734-4743-a7a2-53efaab46116 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:08.466013 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7aef0dd5-6734-4743-a7a2-53efaab46116 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:08.467229 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7aef0dd5-6734-4743-a7a2-53efaab46116 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:08.623511 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7aef0dd5-6734-4743-a7a2-53efaab46116 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:08.634523 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7aef0dd5-6734-4743-a7a2-53efaab46116 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1720 microversion: 2.1 time: 0.180167 Oct 28 12:20:08.644563 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 514/1051] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:08 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:08.741422 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5e3feba6-c991-4ab9-8238-94b858117e2e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Action: 'create', calling method: .version_select at 0x7f11f3629d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-372409146"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:08.775959 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-5e3feba6-c991-4ab9-8238-94b858117e2e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Getting quotas for project cfa9219e414f4bd49dcbf215ed8d6f35. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:20:08.780495 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-5e3feba6-c991-4ab9-8238-94b858117e2e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Getting quotas for user 9cb6619f170a4a2295b89558706885bc and project cfa9219e414f4bd49dcbf215ed8d6f35. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:20:09.090901 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-5e3feba6-c991-4ab9-8238-94b858117e2e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Getting quotas for project cfa9219e414f4bd49dcbf215ed8d6f35. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:20:09.097802 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-5e3feba6-c991-4ab9-8238-94b858117e2e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Getting quotas for user 9cb6619f170a4a2295b89558706885bc and project cfa9219e414f4bd49dcbf215ed8d6f35. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:20:09.114671 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5e3feba6-c991-4ab9-8238-94b858117e2e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.584480 Oct 28 12:20:09.115884 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 538/1052] 10.222.0.37 () {60 vars in 1157 bytes} [Thu Oct 28 12:20:08 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:09.652015 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a62c0e5e-adef-442a-9027-2a4a341c04a0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:09.652612 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a62c0e5e-adef-442a-9027-2a4a341c04a0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:09.659574 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a62c0e5e-adef-442a-9027-2a4a341c04a0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:09.660011 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a62c0e5e-adef-442a-9027-2a4a341c04a0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:09.660775 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a62c0e5e-adef-442a-9027-2a4a341c04a0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:09.661195 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a62c0e5e-adef-442a-9027-2a4a341c04a0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:09.942886 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a62c0e5e-adef-442a-9027-2a4a341c04a0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:09.951513 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a62c0e5e-adef-442a-9027-2a4a341c04a0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1720 microversion: 2.1 time: 0.303350 Oct 28 12:20:09.952081 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 515/1053] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:09 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1720 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:10.970338 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8ed70f67-f67b-4ea9-ae9c-24715442b10d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:10.971037 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8ed70f67-f67b-4ea9-ae9c-24715442b10d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:10.977827 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ed70f67-f67b-4ea9-ae9c-24715442b10d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:10.978272 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ed70f67-f67b-4ea9-ae9c-24715442b10d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:10.979096 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ed70f67-f67b-4ea9-ae9c-24715442b10d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:10.979536 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8ed70f67-f67b-4ea9-ae9c-24715442b10d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:11.107359 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8ed70f67-f67b-4ea9-ae9c-24715442b10d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:11.115334 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8ed70f67-f67b-4ea9-ae9c-24715442b10d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1720 microversion: 2.1 time: 0.149444 Oct 28 12:20:11.115876 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 539/1054] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:10 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:12.133823 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c0ec2b8a-33a0-46b9-af4e-ffa74ab3bd4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:12.134524 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c0ec2b8a-33a0-46b9-af4e-ffa74ab3bd4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:12.140562 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0ec2b8a-33a0-46b9-af4e-ffa74ab3bd4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:12.141388 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0ec2b8a-33a0-46b9-af4e-ffa74ab3bd4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:12.143557 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0ec2b8a-33a0-46b9-af4e-ffa74ab3bd4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:12.143998 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0ec2b8a-33a0-46b9-af4e-ffa74ab3bd4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:12.282958 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c0ec2b8a-33a0-46b9-af4e-ffa74ab3bd4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:12.291846 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c0ec2b8a-33a0-46b9-af4e-ffa74ab3bd4a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1720 microversion: 2.1 time: 0.162575 Oct 28 12:20:12.295062 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 516/1055] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:12 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:13.309079 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0d124cb4-c71e-4052-b81a-ce514816127f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:13.309684 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-0d124cb4-c71e-4052-b81a-ce514816127f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:13.316528 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0d124cb4-c71e-4052-b81a-ce514816127f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:13.316970 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0d124cb4-c71e-4052-b81a-ce514816127f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:13.317765 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0d124cb4-c71e-4052-b81a-ce514816127f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:13.318188 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-0d124cb4-c71e-4052-b81a-ce514816127f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:13.441701 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-0d124cb4-c71e-4052-b81a-ce514816127f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:13.449397 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0d124cb4-c71e-4052-b81a-ce514816127f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1720 microversion: 2.1 time: 0.143988 Oct 28 12:20:13.449961 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 540/1056] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:13 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1720 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:14.465838 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e24b0a51-66dd-4c16-93d9-cc348b111a89 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:14.467058 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e24b0a51-66dd-4c16-93d9-cc348b111a89 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:14.473712 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e24b0a51-66dd-4c16-93d9-cc348b111a89 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:14.474155 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e24b0a51-66dd-4c16-93d9-cc348b111a89 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:14.474973 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e24b0a51-66dd-4c16-93d9-cc348b111a89 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:14.475403 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e24b0a51-66dd-4c16-93d9-cc348b111a89 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:14.592898 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e24b0a51-66dd-4c16-93d9-cc348b111a89 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:14.600895 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e24b0a51-66dd-4c16-93d9-cc348b111a89 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1720 microversion: 2.1 time: 0.138742 Oct 28 12:20:14.601466 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 517/1057] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:14 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1720 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:15.618610 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b2c46c60-b62e-4726-b807-549413634219 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:15.619209 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b2c46c60-b62e-4726-b807-549413634219 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:15.625291 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2c46c60-b62e-4726-b807-549413634219 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:15.625725 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2c46c60-b62e-4726-b807-549413634219 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:15.626547 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2c46c60-b62e-4726-b807-549413634219 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:15.627007 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2c46c60-b62e-4726-b807-549413634219 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:15.755810 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b2c46c60-b62e-4726-b807-549413634219 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:15.763497 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b2c46c60-b62e-4726-b807-549413634219 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1720 microversion: 2.1 time: 0.148782 Oct 28 12:20:15.764075 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 541/1058] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:15 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:16.781019 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5d861a54-1970-4a4e-8443-6beb7b10c571 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:16.781600 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5d861a54-1970-4a4e-8443-6beb7b10c571 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:16.787929 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d861a54-1970-4a4e-8443-6beb7b10c571 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:16.788367 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d861a54-1970-4a4e-8443-6beb7b10c571 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:16.789124 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d861a54-1970-4a4e-8443-6beb7b10c571 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:16.789554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d861a54-1970-4a4e-8443-6beb7b10c571 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:16.916608 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5d861a54-1970-4a4e-8443-6beb7b10c571 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:16.924644 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5d861a54-1970-4a4e-8443-6beb7b10c571 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1720 microversion: 2.1 time: 0.147965 Oct 28 12:20:16.925206 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 518/1059] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:16 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:17.942207 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d9b8956b-a903-4d9f-a6de-689fa9b7a733 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:17.942861 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d9b8956b-a903-4d9f-a6de-689fa9b7a733 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:17.949130 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9b8956b-a903-4d9f-a6de-689fa9b7a733 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:17.949570 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9b8956b-a903-4d9f-a6de-689fa9b7a733 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:17.950327 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9b8956b-a903-4d9f-a6de-689fa9b7a733 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:17.950786 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d9b8956b-a903-4d9f-a6de-689fa9b7a733 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:18.071805 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d9b8956b-a903-4d9f-a6de-689fa9b7a733 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:18.080049 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d9b8956b-a903-4d9f-a6de-689fa9b7a733 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1720 microversion: 2.1 time: 0.141550 Oct 28 12:20:18.080619 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 542/1060] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:17 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1720 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:18.318629 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a1b0dd33-23bd-4470-973a-ee9b31eb407d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:18.319212 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a1b0dd33-23bd-4470-973a-ee9b31eb407d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:18.325334 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a1b0dd33-23bd-4470-973a-ee9b31eb407d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:18.325778 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a1b0dd33-23bd-4470-973a-ee9b31eb407d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:18.326585 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a1b0dd33-23bd-4470-973a-ee9b31eb407d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:18.327044 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a1b0dd33-23bd-4470-973a-ee9b31eb407d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:18.348398 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-a1b0dd33-23bd-4470-973a-ee9b31eb407d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lazy-loading 'flavor' on Instance uuid 8aa26e71-aa24-4d33-9b9f-96d11867d037 {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:20:18.422893 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a1b0dd33-23bd-4470-973a-ee9b31eb407d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "POST /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037/action" status: 202 len: 0 microversion: 2.1 time: 0.107686 Oct 28 12:20:18.423468 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 519/1061] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:20:18 2021] POST /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:20:18.431446 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dc7a8d07-9789-46f3-8a38-117046789815 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:18.432049 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dc7a8d07-9789-46f3-8a38-117046789815 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:18.438719 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc7a8d07-9789-46f3-8a38-117046789815 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:18.439282 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc7a8d07-9789-46f3-8a38-117046789815 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:18.440278 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc7a8d07-9789-46f3-8a38-117046789815 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:18.440850 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc7a8d07-9789-46f3-8a38-117046789815 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:18.558693 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-dc7a8d07-9789-46f3-8a38-117046789815 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:18.566556 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dc7a8d07-9789-46f3-8a38-117046789815 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1567 microversion: 2.1 time: 0.138680 Oct 28 12:20:18.567161 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 543/1062] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:18 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:19.098891 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-446c33c6-a070-4663-939c-93b7d07a2253 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:19.099584 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-446c33c6-a070-4663-939c-93b7d07a2253 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:19.105543 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-446c33c6-a070-4663-939c-93b7d07a2253 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:19.105984 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-446c33c6-a070-4663-939c-93b7d07a2253 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:19.107172 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-446c33c6-a070-4663-939c-93b7d07a2253 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:19.107607 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-446c33c6-a070-4663-939c-93b7d07a2253 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:19.128284 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-440eba4d-7d43-402c-bb9e-f715f3bd0292 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:19.128838 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-440eba4d-7d43-402c-bb9e-f715f3bd0292 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:19.135004 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-440eba4d-7d43-402c-bb9e-f715f3bd0292 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:19.135483 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-440eba4d-7d43-402c-bb9e-f715f3bd0292 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:19.136238 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-440eba4d-7d43-402c-bb9e-f715f3bd0292 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:19.136658 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-440eba4d-7d43-402c-bb9e-f715f3bd0292 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:19.167417 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-440eba4d-7d43-402c-bb9e-f715f3bd0292 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/os-volume_attachments/ff763d94-5640-46b8-88ca-76f385e94cf4" status: 200 len: 194 microversion: 2.20 time: 0.042986 Oct 28 12:20:19.168003 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 544/1063] 10.222.0.37 () {60 vars in 1453 bytes} [Thu Oct 28 12:20:19 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/os-volume_attachments/ff763d94-5640-46b8-88ca-76f385e94cf4 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:20:19.226495 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8492a090-efd1-48f3-bf23-9a72857940b7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:19.227001 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8492a090-efd1-48f3-bf23-9a72857940b7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:19.237573 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8492a090-efd1-48f3-bf23-9a72857940b7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:19.237573 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8492a090-efd1-48f3-bf23-9a72857940b7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:19.237573 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8492a090-efd1-48f3-bf23-9a72857940b7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:19.237573 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8492a090-efd1-48f3-bf23-9a72857940b7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:19.237957 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-446c33c6-a070-4663-939c-93b7d07a2253 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:19.243989 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-446c33c6-a070-4663-939c-93b7d07a2253 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1720 microversion: 2.1 time: 0.149035 Oct 28 12:20:19.244789 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 520/1064] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:19 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:19.314454 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-8492a090-efd1-48f3-bf23-9a72857940b7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lazy-loading 'services' on Instance uuid d79ab524-bc96-45ce-91df-6713d6fcaaaf {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:20:19.380887 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8492a090-efd1-48f3-bf23-9a72857940b7 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "DELETE /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/os-volume_attachments/ff763d94-5640-46b8-88ca-76f385e94cf4" status: 202 len: 0 microversion: 2.20 time: 0.157947 Oct 28 12:20:19.381549 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 545/1065] 10.222.0.37 () {60 vars in 1456 bytes} [Thu Oct 28 12:20:19 2021] DELETE /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/os-volume_attachments/ff763d94-5640-46b8-88ca-76f385e94cf4 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 28 12:20:19.390496 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9fdcc986-575b-43ca-91ed-ad27ecaa244e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:19.391471 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9fdcc986-575b-43ca-91ed-ad27ecaa244e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:19.397361 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9fdcc986-575b-43ca-91ed-ad27ecaa244e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:19.397816 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9fdcc986-575b-43ca-91ed-ad27ecaa244e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:19.398631 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9fdcc986-575b-43ca-91ed-ad27ecaa244e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:19.399317 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9fdcc986-575b-43ca-91ed-ad27ecaa244e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:19.431554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9fdcc986-575b-43ca-91ed-ad27ecaa244e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045423 Oct 28 12:20:19.432117 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 521/1066] 10.222.0.37 () {60 vars in 1342 bytes} [Thu Oct 28 12:20:19 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:20:19.584017 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1a93c7a7-0379-472d-948c-06fee83b8db1 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:19.584699 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1a93c7a7-0379-472d-948c-06fee83b8db1 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:19.590748 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1a93c7a7-0379-472d-948c-06fee83b8db1 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:19.591188 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1a93c7a7-0379-472d-948c-06fee83b8db1 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:19.591980 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1a93c7a7-0379-472d-948c-06fee83b8db1 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:19.592405 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1a93c7a7-0379-472d-948c-06fee83b8db1 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:19.720751 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1a93c7a7-0379-472d-948c-06fee83b8db1 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:19.727935 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1a93c7a7-0379-472d-948c-06fee83b8db1 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1567 microversion: 2.1 time: 0.147916 Oct 28 12:20:19.728483 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 546/1067] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:19 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:20.261288 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6b2433b8-0eb9-4f94-9ff0-287453ef541b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:20.261818 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6b2433b8-0eb9-4f94-9ff0-287453ef541b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:20.267569 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6b2433b8-0eb9-4f94-9ff0-287453ef541b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:20.268019 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6b2433b8-0eb9-4f94-9ff0-287453ef541b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:20.268800 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6b2433b8-0eb9-4f94-9ff0-287453ef541b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:20.269221 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6b2433b8-0eb9-4f94-9ff0-287453ef541b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:20.409622 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-6b2433b8-0eb9-4f94-9ff0-287453ef541b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:20.417450 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6b2433b8-0eb9-4f94-9ff0-287453ef541b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1720 microversion: 2.1 time: 0.159975 Oct 28 12:20:20.418014 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 522/1068] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:20 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:20.443497 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7813f7d5-ad11-48fc-aaa3-463ac262818e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:20.444455 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7813f7d5-ad11-48fc-aaa3-463ac262818e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:20.450537 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7813f7d5-ad11-48fc-aaa3-463ac262818e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:20.451561 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7813f7d5-ad11-48fc-aaa3-463ac262818e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:20.452308 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7813f7d5-ad11-48fc-aaa3-463ac262818e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:20.452726 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7813f7d5-ad11-48fc-aaa3-463ac262818e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:20.482322 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7813f7d5-ad11-48fc-aaa3-463ac262818e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042599 Oct 28 12:20:20.482888 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 547/1069] 10.222.0.37 () {60 vars in 1342 bytes} [Thu Oct 28 12:20:20 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:20.540764 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-928f37c5-5718-42e9-85f1-3d75dd1e8baa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:20.541261 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-928f37c5-5718-42e9-85f1-3d75dd1e8baa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:20.547378 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-928f37c5-5718-42e9-85f1-3d75dd1e8baa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:20.547824 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-928f37c5-5718-42e9-85f1-3d75dd1e8baa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:20.548591 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-928f37c5-5718-42e9-85f1-3d75dd1e8baa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:20.549025 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-928f37c5-5718-42e9-85f1-3d75dd1e8baa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:20.572425 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-928f37c5-5718-42e9-85f1-3d75dd1e8baa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:20:20.644605 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-928f37c5-5718-42e9-85f1-3d75dd1e8baa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "DELETE /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 204 len: 0 microversion: 2.20 time: 0.107022 Oct 28 12:20:20.645383 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 523/1070] 10.222.0.37 () {60 vars in 1279 bytes} [Thu Oct 28 12:20:20 2021] DELETE /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 12:20:20.653657 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b83f3a44-5228-4012-b668-8e990c4c9050 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:20.654936 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b83f3a44-5228-4012-b668-8e990c4c9050 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:20.660712 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b83f3a44-5228-4012-b668-8e990c4c9050 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:20.661143 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b83f3a44-5228-4012-b668-8e990c4c9050 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:20.661893 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b83f3a44-5228-4012-b668-8e990c4c9050 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:20.662317 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b83f3a44-5228-4012-b668-8e990c4c9050 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:20.746052 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e3a9e620-3c46-438d-8db4-1aeee4c8b801 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:20.746885 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e3a9e620-3c46-438d-8db4-1aeee4c8b801 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:20.752791 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e3a9e620-3c46-438d-8db4-1aeee4c8b801 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:20.753348 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e3a9e620-3c46-438d-8db4-1aeee4c8b801 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:20.754214 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e3a9e620-3c46-438d-8db4-1aeee4c8b801 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:20.754746 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e3a9e620-3c46-438d-8db4-1aeee4c8b801 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:20.784918 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b83f3a44-5228-4012-b668-8e990c4c9050 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:20.792725 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b83f3a44-5228-4012-b668-8e990c4c9050 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:20.794472 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b83f3a44-5228-4012-b668-8e990c4c9050 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:20.795712 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b83f3a44-5228-4012-b668-8e990c4c9050 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.146011 Oct 28 12:20:20.796301 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 548/1071] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:20:20 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:20:20.879074 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e3a9e620-3c46-438d-8db4-1aeee4c8b801 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:20.886543 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e3a9e620-3c46-438d-8db4-1aeee4c8b801 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1567 microversion: 2.1 time: 0.144826 Oct 28 12:20:20.887177 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 524/1072] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:20 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:21.434232 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7d1773ed-5a38-4f90-bb96-c092f938cce0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:21.434879 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7d1773ed-5a38-4f90-bb96-c092f938cce0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:21.441350 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d1773ed-5a38-4f90-bb96-c092f938cce0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:21.441789 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d1773ed-5a38-4f90-bb96-c092f938cce0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:21.442535 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d1773ed-5a38-4f90-bb96-c092f938cce0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:21.442991 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d1773ed-5a38-4f90-bb96-c092f938cce0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:21.568298 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7d1773ed-5a38-4f90-bb96-c092f938cce0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:21.576004 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7d1773ed-5a38-4f90-bb96-c092f938cce0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1720 microversion: 2.1 time: 0.145377 Oct 28 12:20:21.576603 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 549/1073] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:21 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1720 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:21.815251 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-779f4479-fa37-4df2-815a-c7fc57518b4e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:21.815798 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-779f4479-fa37-4df2-815a-c7fc57518b4e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:21.821966 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-779f4479-fa37-4df2-815a-c7fc57518b4e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:21.822406 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-779f4479-fa37-4df2-815a-c7fc57518b4e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:21.823209 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-779f4479-fa37-4df2-815a-c7fc57518b4e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:21.823634 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-779f4479-fa37-4df2-815a-c7fc57518b4e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:21.904716 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cc2d75c3-d9f8-445c-9530-daeec54a6efa tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:21.905402 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cc2d75c3-d9f8-445c-9530-daeec54a6efa tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:21.911337 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cc2d75c3-d9f8-445c-9530-daeec54a6efa tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:21.911848 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cc2d75c3-d9f8-445c-9530-daeec54a6efa tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:21.912674 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cc2d75c3-d9f8-445c-9530-daeec54a6efa tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:21.913168 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cc2d75c3-d9f8-445c-9530-daeec54a6efa tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:21.953314 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-779f4479-fa37-4df2-815a-c7fc57518b4e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:21.962187 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-779f4479-fa37-4df2-815a-c7fc57518b4e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:21.963726 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-779f4479-fa37-4df2-815a-c7fc57518b4e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:21.964905 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-779f4479-fa37-4df2-815a-c7fc57518b4e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.153493 Oct 28 12:20:21.965472 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 525/1074] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:20:21 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:20:22.038350 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-cc2d75c3-d9f8-445c-9530-daeec54a6efa tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:22.046132 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cc2d75c3-d9f8-445c-9530-daeec54a6efa tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1567 microversion: 2.1 time: 0.145514 Oct 28 12:20:22.046730 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 550/1075] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:21 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:22.592558 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c892a860-0b94-4d43-85d7-96c8a8c6c183 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:22.593161 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c892a860-0b94-4d43-85d7-96c8a8c6c183 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:22.599028 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c892a860-0b94-4d43-85d7-96c8a8c6c183 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:22.599482 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c892a860-0b94-4d43-85d7-96c8a8c6c183 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:22.600260 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c892a860-0b94-4d43-85d7-96c8a8c6c183 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:22.600695 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c892a860-0b94-4d43-85d7-96c8a8c6c183 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:22.750186 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c892a860-0b94-4d43-85d7-96c8a8c6c183 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:22.757992 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c892a860-0b94-4d43-85d7-96c8a8c6c183 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1720 microversion: 2.1 time: 0.169023 Oct 28 12:20:22.758560 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 526/1076] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:22 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:22.983247 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-610f16ba-c780-44dd-a815-21ce2e58d34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:22.983876 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-610f16ba-c780-44dd-a815-21ce2e58d34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:22.989952 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-610f16ba-c780-44dd-a815-21ce2e58d34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:22.990393 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-610f16ba-c780-44dd-a815-21ce2e58d34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:22.991181 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-610f16ba-c780-44dd-a815-21ce2e58d34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:22.991603 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-610f16ba-c780-44dd-a815-21ce2e58d34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:23.066186 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-64ed2bc5-c239-4643-9720-30840e67fafb tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:23.066855 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-64ed2bc5-c239-4643-9720-30840e67fafb tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:23.073031 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-64ed2bc5-c239-4643-9720-30840e67fafb tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:23.073478 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-64ed2bc5-c239-4643-9720-30840e67fafb tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:23.074245 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-64ed2bc5-c239-4643-9720-30840e67fafb tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:23.074696 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-64ed2bc5-c239-4643-9720-30840e67fafb tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:23.200589 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-64ed2bc5-c239-4643-9720-30840e67fafb tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:23.207955 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-64ed2bc5-c239-4643-9720-30840e67fafb tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1567 microversion: 2.1 time: 0.145380 Oct 28 12:20:23.208514 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 527/1077] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:23 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:23.254009 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-610f16ba-c780-44dd-a815-21ce2e58d34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:23.261736 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-610f16ba-c780-44dd-a815-21ce2e58d34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:23.263286 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-610f16ba-c780-44dd-a815-21ce2e58d34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:23.264444 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-610f16ba-c780-44dd-a815-21ce2e58d34a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 200 len: 1722 microversion: 2.20 time: 0.285531 Oct 28 12:20:23.265031 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 551/1078] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:20:22 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 1722 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:20:23.636955 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-12e40d4d-e1ee-488c-9bad-5a495e71b927 req-23c36328-13a0-4470-b73e-584501b370f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79ab524-bc96-45ce-91df-6713d6fcaaaf", "name": "network-vif-deleted", "tag": "f783de9c-03e4-446f-b34b-e2edaa551d3c"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:23.639057 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:20:23.639057 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:20:23.647791 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-12e40d4d-e1ee-488c-9bad-5a495e71b927 req-23c36328-13a0-4470-b73e-584501b370f0 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:23.648252 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-12e40d4d-e1ee-488c-9bad-5a495e71b927 req-23c36328-13a0-4470-b73e-584501b370f0 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:23.660200 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-12e40d4d-e1ee-488c-9bad-5a495e71b927 req-23c36328-13a0-4470-b73e-584501b370f0 service nova] Creating event network-vif-deleted:f783de9c-03e4-446f-b34b-e2edaa551d3c for instance d79ab524-bc96-45ce-91df-6713d6fcaaaf on hv-cinder-81571 Oct 28 12:20:23.665015 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-12e40d4d-e1ee-488c-9bad-5a495e71b927 req-23c36328-13a0-4470-b73e-584501b370f0 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031658 Oct 28 12:20:23.666147 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 528/1079] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:20:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:20:23.776860 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ad45797b-11ea-41db-900c-02b3a10c2ddd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:23.777750 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ad45797b-11ea-41db-900c-02b3a10c2ddd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:23.785473 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad45797b-11ea-41db-900c-02b3a10c2ddd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:23.786439 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad45797b-11ea-41db-900c-02b3a10c2ddd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:23.787408 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad45797b-11ea-41db-900c-02b3a10c2ddd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:23.788029 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad45797b-11ea-41db-900c-02b3a10c2ddd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:23.958663 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ad45797b-11ea-41db-900c-02b3a10c2ddd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:23.968047 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ad45797b-11ea-41db-900c-02b3a10c2ddd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1720 microversion: 2.1 time: 0.195138 Oct 28 12:20:23.968627 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 552/1080] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:23 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:24.226732 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-dfbe51c9-65e1-41a1-8e56-40d7f55f3e33 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:24.227436 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-dfbe51c9-65e1-41a1-8e56-40d7f55f3e33 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:24.234405 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dfbe51c9-65e1-41a1-8e56-40d7f55f3e33 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:24.235167 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dfbe51c9-65e1-41a1-8e56-40d7f55f3e33 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:24.236255 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dfbe51c9-65e1-41a1-8e56-40d7f55f3e33 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:24.236897 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dfbe51c9-65e1-41a1-8e56-40d7f55f3e33 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:24.284118 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2d95b170-119e-44c2-b2c3-9ee77f1eef6b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:24.286077 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2d95b170-119e-44c2-b2c3-9ee77f1eef6b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:24.293749 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2d95b170-119e-44c2-b2c3-9ee77f1eef6b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:24.295279 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2d95b170-119e-44c2-b2c3-9ee77f1eef6b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:24.296345 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2d95b170-119e-44c2-b2c3-9ee77f1eef6b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:24.297079 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2d95b170-119e-44c2-b2c3-9ee77f1eef6b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:24.335259 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-2d95b170-119e-44c2-b2c3-9ee77f1eef6b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] HTTP exception thrown: Instance d79ab524-bc96-45ce-91df-6713d6fcaaaf could not be found. Oct 28 12:20:24.335952 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2d95b170-119e-44c2-b2c3-9ee77f1eef6b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Returning 404 to user: Instance d79ab524-bc96-45ce-91df-6713d6fcaaaf could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:20:24.336812 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2d95b170-119e-44c2-b2c3-9ee77f1eef6b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 404 len: 111 microversion: 2.20 time: 0.056803 Oct 28 12:20:24.337424 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 553/1081] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:20:24 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 12:20:24.346805 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e8e4bc71-5928-4b06-89cc-a39cc212a929 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '.version_select at 0x7f11f358b940>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:24.372522 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e8e4bc71-5928-4b06-89cc-a39cc212a929 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-618544896" status: 204 len: 0 microversion: 2.20 time: 0.030095 Oct 28 12:20:24.374636 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 554/1082] 10.222.0.37 () {60 vars in 1258 bytes} [Thu Oct 28 12:20:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-618544896 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 12:20:24.439088 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-dfbe51c9-65e1-41a1-8e56-40d7f55f3e33 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:24.455414 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-dfbe51c9-65e1-41a1-8e56-40d7f55f3e33 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1567 microversion: 2.1 time: 0.233092 Oct 28 12:20:24.456725 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 529/1083] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:24 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:24.985500 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3803445c-b7ad-45ae-8c32-eaaac5ce9d91 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:24.986106 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3803445c-b7ad-45ae-8c32-eaaac5ce9d91 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:24.993426 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3803445c-b7ad-45ae-8c32-eaaac5ce9d91 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:24.993860 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3803445c-b7ad-45ae-8c32-eaaac5ce9d91 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:24.994637 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3803445c-b7ad-45ae-8c32-eaaac5ce9d91 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:24.995090 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3803445c-b7ad-45ae-8c32-eaaac5ce9d91 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:25.181679 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8b75c089-1809-443b-a294-607d5e4dd79f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'create', calling method: .version_select at 0x7f11f2e06e50>, body: {"keypair": {"name": "tempest-keypair-38731555"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:25.183871 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3803445c-b7ad-45ae-8c32-eaaac5ce9d91 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:25.195684 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3803445c-b7ad-45ae-8c32-eaaac5ce9d91 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1720 microversion: 2.1 time: 0.214417 Oct 28 12:20:25.196340 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 555/1084] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:24 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:25.211552 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-8b75c089-1809-443b-a294-607d5e4dd79f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Getting quotas for project e8919258b85146488d50b07efbad50ca. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:20:25.215690 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-8b75c089-1809-443b-a294-607d5e4dd79f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Getting quotas for user 8df0567fb17c4b159e7bf0df45012f84 and project e8919258b85146488d50b07efbad50ca. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:20:25.377338 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-8b75c089-1809-443b-a294-607d5e4dd79f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Getting quotas for project e8919258b85146488d50b07efbad50ca. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:20:25.381059 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-8b75c089-1809-443b-a294-607d5e4dd79f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Getting quotas for user 8df0567fb17c4b159e7bf0df45012f84 and project e8919258b85146488d50b07efbad50ca. Resources: {'key_pairs'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:20:25.393474 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8b75c089-1809-443b-a294-607d5e4dd79f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 201 len: 2318 microversion: 2.20 time: 0.216033 Oct 28 12:20:25.394064 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 530/1085] 10.222.0.37 () {62 vars in 1198 bytes} [Thu Oct 28 12:20:25 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 217 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Oct 28 12:20:25.472886 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-33171652-32ff-4187-aef9-e59e4ab5d361 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:25.473493 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-33171652-32ff-4187-aef9-e59e4ab5d361 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:25.480414 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-33171652-32ff-4187-aef9-e59e4ab5d361 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:25.481033 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-33171652-32ff-4187-aef9-e59e4ab5d361 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:25.481899 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-33171652-32ff-4187-aef9-e59e4ab5d361 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:25.483169 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-33171652-32ff-4187-aef9-e59e4ab5d361 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:25.635137 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-33171652-32ff-4187-aef9-e59e4ab5d361 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:25.642480 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-33171652-32ff-4187-aef9-e59e4ab5d361 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1567 microversion: 2.1 time: 0.173450 Oct 28 12:20:25.643106 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 556/1086] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:25 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:26.213184 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4ce09d6d-7c34-449a-92dd-dadcfa67af5a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:26.213787 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4ce09d6d-7c34-449a-92dd-dadcfa67af5a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:26.219601 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ce09d6d-7c34-449a-92dd-dadcfa67af5a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:26.220049 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ce09d6d-7c34-449a-92dd-dadcfa67af5a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:26.220823 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ce09d6d-7c34-449a-92dd-dadcfa67af5a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:26.221248 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4ce09d6d-7c34-449a-92dd-dadcfa67af5a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:26.404757 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4ce09d6d-7c34-449a-92dd-dadcfa67af5a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:26.412554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4ce09d6d-7c34-449a-92dd-dadcfa67af5a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1697 microversion: 2.1 time: 0.203566 Oct 28 12:20:26.413121 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 531/1087] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:26 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1697 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:26.429660 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fe1304b2-0b50-4271-be9d-98c3d620b072 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:26.436042 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe1304b2-0b50-4271-be9d-98c3d620b072 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:26.436484 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe1304b2-0b50-4271-be9d-98c3d620b072 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:26.503977 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fe1304b2-0b50-4271-be9d-98c3d620b072 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Going to try to start instance {{(pid=115798) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 28 12:20:26.545203 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fe1304b2-0b50-4271-be9d-98c3d620b072 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 202 len: 0 microversion: 2.1 time: 0.118193 Oct 28 12:20:26.545869 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 557/1088] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:20:26 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:20:26.554295 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-13628744-9a0c-474b-ab82-2c46cc2dc2ef tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:26.555169 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-13628744-9a0c-474b-ab82-2c46cc2dc2ef tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:26.564160 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-13628744-9a0c-474b-ab82-2c46cc2dc2ef tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:26.564609 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-13628744-9a0c-474b-ab82-2c46cc2dc2ef tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:26.565831 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-13628744-9a0c-474b-ab82-2c46cc2dc2ef tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:26.568445 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-13628744-9a0c-474b-ab82-2c46cc2dc2ef tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:26.660218 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6e8028ab-5a15-4b49-96ee-5cdfa803d76a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:26.661869 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6e8028ab-5a15-4b49-96ee-5cdfa803d76a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:26.669880 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6e8028ab-5a15-4b49-96ee-5cdfa803d76a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:26.670346 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6e8028ab-5a15-4b49-96ee-5cdfa803d76a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:26.671842 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6e8028ab-5a15-4b49-96ee-5cdfa803d76a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:26.672280 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6e8028ab-5a15-4b49-96ee-5cdfa803d76a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:26.752271 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-13628744-9a0c-474b-ab82-2c46cc2dc2ef tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:26.760605 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-13628744-9a0c-474b-ab82-2c46cc2dc2ef tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1706 microversion: 2.1 time: 0.210301 Oct 28 12:20:26.761197 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 532/1089] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:26 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1706 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:26.800345 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ac69beb4-c0df-4f27-9f63-9e646b45dfd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1438111894", "imageRef": "4385a199-a3e9-4c11-b580-60e7a24d0e97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5853af4e-080d-4f95-bfd5-3fa948549140"}], "security_groups": [{"name": "tempest-securitygroup--739782661"}], "key_name": "tempest-keypair-38731555", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:26.900138 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6e8028ab-5a15-4b49-96ee-5cdfa803d76a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:26.908805 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-ac69beb4-c0df-4f27-9f63-9e646b45dfd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] validate_networks() for [('5853af4e-080d-4f95-bfd5-3fa948549140', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:20:26.909649 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6e8028ab-5a15-4b49-96ee-5cdfa803d76a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1567 microversion: 2.1 time: 0.253352 Oct 28 12:20:26.910440 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 558/1090] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:26 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:27.282473 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-ac69beb4-c0df-4f27-9f63-9e646b45dfd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:20:27.282928 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-ac69beb4-c0df-4f27-9f63-9e646b45dfd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:20:27.283396 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-ac69beb4-c0df-4f27-9f63-9e646b45dfd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:20:27.283988 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-ac69beb4-c0df-4f27-9f63-9e646b45dfd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:20:27.284393 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-ac69beb4-c0df-4f27-9f63-9e646b45dfd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:20:27.293063 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac69beb4-c0df-4f27-9f63-9e646b45dfd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:27.293511 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac69beb4-c0df-4f27-9f63-9e646b45dfd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:27.294567 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac69beb4-c0df-4f27-9f63-9e646b45dfd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:27.295021 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac69beb4-c0df-4f27-9f63-9e646b45dfd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:27.310914 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-ac69beb4-c0df-4f27-9f63-9e646b45dfd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Getting quotas for project e8919258b85146488d50b07efbad50ca. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:20:27.314630 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-ac69beb4-c0df-4f27-9f63-9e646b45dfd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Getting quotas for user 8df0567fb17c4b159e7bf0df45012f84 and project e8919258b85146488d50b07efbad50ca. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:20:27.325273 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ac69beb4-c0df-4f27-9f63-9e646b45dfd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:20:27.328164 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ac69beb4-c0df-4f27-9f63-9e646b45dfd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4385a199-a3e9-4c11-b580-60e7a24d0e97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:20:27.373770 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ac69beb4-c0df-4f27-9f63-9e646b45dfd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.577411 Oct 28 12:20:27.374436 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 533/1091] 10.222.0.37 () {62 vars in 1187 bytes} [Thu Oct 28 12:20:26 2021] POST /compute/v2.1/servers => generated 401 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 28 12:20:27.384751 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-022daa49-a3ff-4e69-b66c-e35f723a987a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:27.385539 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-022daa49-a3ff-4e69-b66c-e35f723a987a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:27.438838 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-022daa49-a3ff-4e69-b66c-e35f723a987a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:27.445902 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-022daa49-a3ff-4e69-b66c-e35f723a987a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:27.447432 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-022daa49-a3ff-4e69-b66c-e35f723a987a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:27.448514 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-022daa49-a3ff-4e69-b66c-e35f723a987a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1280 microversion: 2.20 time: 0.067456 Oct 28 12:20:27.449068 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 559/1092] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:20:27 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:20:27.777379 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-148d5e75-0f9e-4ad6-9d6b-a9324e7597a5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:27.777979 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-148d5e75-0f9e-4ad6-9d6b-a9324e7597a5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:27.785583 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-148d5e75-0f9e-4ad6-9d6b-a9324e7597a5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:27.786056 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-148d5e75-0f9e-4ad6-9d6b-a9324e7597a5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:27.786857 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-148d5e75-0f9e-4ad6-9d6b-a9324e7597a5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:27.787287 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-148d5e75-0f9e-4ad6-9d6b-a9324e7597a5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:27.922387 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-148d5e75-0f9e-4ad6-9d6b-a9324e7597a5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:27.929171 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-afe5537e-8ed3-4d15-84ae-98a6334b4139 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:27.929815 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-afe5537e-8ed3-4d15-84ae-98a6334b4139 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:27.932020 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-148d5e75-0f9e-4ad6-9d6b-a9324e7597a5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1706 microversion: 2.1 time: 0.157990 Oct 28 12:20:27.932923 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 534/1093] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:27 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1706 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:27.940869 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-afe5537e-8ed3-4d15-84ae-98a6334b4139 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:27.941310 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-afe5537e-8ed3-4d15-84ae-98a6334b4139 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:27.942196 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-afe5537e-8ed3-4d15-84ae-98a6334b4139 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:27.942787 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-afe5537e-8ed3-4d15-84ae-98a6334b4139 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:28.077968 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-afe5537e-8ed3-4d15-84ae-98a6334b4139 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:28.085264 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-afe5537e-8ed3-4d15-84ae-98a6334b4139 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1567 microversion: 2.1 time: 0.159857 Oct 28 12:20:28.085819 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 560/1094] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:27 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:28.466306 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3c373b20-c52b-4776-a809-c78c9f92ecdb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:28.466933 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3c373b20-c52b-4776-a809-c78c9f92ecdb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:28.473460 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3c373b20-c52b-4776-a809-c78c9f92ecdb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:28.473912 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3c373b20-c52b-4776-a809-c78c9f92ecdb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:28.474757 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3c373b20-c52b-4776-a809-c78c9f92ecdb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:28.475197 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3c373b20-c52b-4776-a809-c78c9f92ecdb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:28.534666 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3c373b20-c52b-4776-a809-c78c9f92ecdb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:28.542704 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3c373b20-c52b-4776-a809-c78c9f92ecdb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:28.544463 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3c373b20-c52b-4776-a809-c78c9f92ecdb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:28.545807 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3c373b20-c52b-4776-a809-c78c9f92ecdb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1338 microversion: 2.20 time: 0.082957 Oct 28 12:20:28.552926 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 535/1095] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:20:28 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1338 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:20:28.949487 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b7c48206-c112-49ea-94a4-bceb13e49d77 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:28.950092 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b7c48206-c112-49ea-94a4-bceb13e49d77 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:28.957192 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b7c48206-c112-49ea-94a4-bceb13e49d77 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:28.957636 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b7c48206-c112-49ea-94a4-bceb13e49d77 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:28.958419 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b7c48206-c112-49ea-94a4-bceb13e49d77 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:28.958879 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b7c48206-c112-49ea-94a4-bceb13e49d77 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:29.102700 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4b33d8d9-4878-41b8-b355-198f6614da6d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:29.103302 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4b33d8d9-4878-41b8-b355-198f6614da6d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:29.108999 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4b33d8d9-4878-41b8-b355-198f6614da6d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:29.109518 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4b33d8d9-4878-41b8-b355-198f6614da6d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:29.110537 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4b33d8d9-4878-41b8-b355-198f6614da6d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:29.111015 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4b33d8d9-4878-41b8-b355-198f6614da6d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:29.254199 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4b33d8d9-4878-41b8-b355-198f6614da6d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:29.258809 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b7c48206-c112-49ea-94a4-bceb13e49d77 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:29.262551 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4b33d8d9-4878-41b8-b355-198f6614da6d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1567 microversion: 2.1 time: 0.163499 Oct 28 12:20:29.264130 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 536/1096] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:29 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:29.267626 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b7c48206-c112-49ea-94a4-bceb13e49d77 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1710 microversion: 2.1 time: 0.321788 Oct 28 12:20:29.268352 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 561/1097] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:28 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1710 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:29.565448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5ac698fc-57ed-4f67-b934-31d74948e833 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:29.566054 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5ac698fc-57ed-4f67-b934-31d74948e833 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:29.572868 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ac698fc-57ed-4f67-b934-31d74948e833 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:29.573319 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ac698fc-57ed-4f67-b934-31d74948e833 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:29.574096 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ac698fc-57ed-4f67-b934-31d74948e833 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:29.574537 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5ac698fc-57ed-4f67-b934-31d74948e833 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:29.699000 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5ac698fc-57ed-4f67-b934-31d74948e833 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:29.706669 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5ac698fc-57ed-4f67-b934-31d74948e833 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:29.708188 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5ac698fc-57ed-4f67-b934-31d74948e833 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:29.709299 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5ac698fc-57ed-4f67-b934-31d74948e833 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1405 microversion: 2.20 time: 0.147702 Oct 28 12:20:29.709862 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 537/1098] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:20:29 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:20:29.986204 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-f7139a60-60f5-495c-9ba9-63a400bb9698 req-2b6b3661-bb53-42a4-8640-421c73ffd0bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19635150-a15f-4d59-a3a3-adc15a411e40", "tag": "df78786b-91a7-4ab8-9ff2-b69bbf31776f"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:29.988382 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:20:29.988382 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:20:29.999715 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-f7139a60-60f5-495c-9ba9-63a400bb9698 req-2b6b3661-bb53-42a4-8640-421c73ffd0bb service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:30.000640 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-f7139a60-60f5-495c-9ba9-63a400bb9698 req-2b6b3661-bb53-42a4-8640-421c73ffd0bb service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:30.014092 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-f7139a60-60f5-495c-9ba9-63a400bb9698 req-2b6b3661-bb53-42a4-8640-421c73ffd0bb service nova] Creating event network-changed:df78786b-91a7-4ab8-9ff2-b69bbf31776f for instance 19635150-a15f-4d59-a3a3-adc15a411e40 on hv-cinder-81571 Oct 28 12:20:30.019528 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-f7139a60-60f5-495c-9ba9-63a400bb9698 req-2b6b3661-bb53-42a4-8640-421c73ffd0bb service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037114 Oct 28 12:20:30.020335 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 562/1099] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:20:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:20:30.280292 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2e419807-157f-4189-9093-3f9d34299970 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:30.280899 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2e419807-157f-4189-9093-3f9d34299970 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:30.286707 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2e419807-157f-4189-9093-3f9d34299970 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:30.287256 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2e419807-157f-4189-9093-3f9d34299970 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:30.287961 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2e419807-157f-4189-9093-3f9d34299970 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:30.288407 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2e419807-157f-4189-9093-3f9d34299970 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:30.412015 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2e419807-157f-4189-9093-3f9d34299970 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:30.420958 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2e419807-157f-4189-9093-3f9d34299970 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1567 microversion: 2.1 time: 0.143964 Oct 28 12:20:30.421216 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 538/1100] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:30 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:30.727998 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-89b04196-1758-4cee-bde9-12d2ca463fcc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:30.728681 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-89b04196-1758-4cee-bde9-12d2ca463fcc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:30.735472 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-89b04196-1758-4cee-bde9-12d2ca463fcc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:30.735906 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-89b04196-1758-4cee-bde9-12d2ca463fcc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:30.736659 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-89b04196-1758-4cee-bde9-12d2ca463fcc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:30.737082 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-89b04196-1758-4cee-bde9-12d2ca463fcc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:30.941077 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-89b04196-1758-4cee-bde9-12d2ca463fcc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:30.949221 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-89b04196-1758-4cee-bde9-12d2ca463fcc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:30.951221 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-89b04196-1758-4cee-bde9-12d2ca463fcc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:30.952306 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-89b04196-1758-4cee-bde9-12d2ca463fcc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1405 microversion: 2.20 time: 0.228418 Oct 28 12:20:30.952867 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 563/1101] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:20:30 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:20:31.437504 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c25cd1f4-c9c6-4c76-888c-aa0c7722daf4 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:31.438117 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c25cd1f4-c9c6-4c76-888c-aa0c7722daf4 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:31.444399 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c25cd1f4-c9c6-4c76-888c-aa0c7722daf4 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:31.444842 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c25cd1f4-c9c6-4c76-888c-aa0c7722daf4 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:31.445611 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c25cd1f4-c9c6-4c76-888c-aa0c7722daf4 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:31.446044 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c25cd1f4-c9c6-4c76-888c-aa0c7722daf4 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:31.566754 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c25cd1f4-c9c6-4c76-888c-aa0c7722daf4 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:31.573878 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c25cd1f4-c9c6-4c76-888c-aa0c7722daf4 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1567 microversion: 2.1 time: 0.140263 Oct 28 12:20:31.574438 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 539/1102] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:31 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1567 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:31.970538 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a9b60bd7-d8a5-469a-805d-101ceed6575e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:31.971175 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a9b60bd7-d8a5-469a-805d-101ceed6575e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:31.977439 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a9b60bd7-d8a5-469a-805d-101ceed6575e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:31.977881 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a9b60bd7-d8a5-469a-805d-101ceed6575e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:31.978636 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a9b60bd7-d8a5-469a-805d-101ceed6575e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:31.979087 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a9b60bd7-d8a5-469a-805d-101ceed6575e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:32.101530 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a9b60bd7-d8a5-469a-805d-101ceed6575e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:32.109065 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a9b60bd7-d8a5-469a-805d-101ceed6575e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:32.110575 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a9b60bd7-d8a5-469a-805d-101ceed6575e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:32.111686 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a9b60bd7-d8a5-469a-805d-101ceed6575e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1405 microversion: 2.20 time: 0.145553 Oct 28 12:20:32.112232 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 564/1103] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:20:31 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1405 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:20:32.590793 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cc1cda9a-4cba-4120-9e92-1892d15f4364 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:32.591519 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cc1cda9a-4cba-4120-9e92-1892d15f4364 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:32.597582 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cc1cda9a-4cba-4120-9e92-1892d15f4364 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:32.598034 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cc1cda9a-4cba-4120-9e92-1892d15f4364 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:32.598839 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cc1cda9a-4cba-4120-9e92-1892d15f4364 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:32.599276 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cc1cda9a-4cba-4120-9e92-1892d15f4364 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:32.726848 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cc1cda9a-4cba-4120-9e92-1892d15f4364 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:32.734691 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cc1cda9a-4cba-4120-9e92-1892d15f4364 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1567 microversion: 2.1 time: 0.147803 Oct 28 12:20:32.735274 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 540/1104] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:32 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:33.129196 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1090b608-5d98-41a2-a8dd-0ca4fda70432 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:33.129807 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1090b608-5d98-41a2-a8dd-0ca4fda70432 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:33.136045 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1090b608-5d98-41a2-a8dd-0ca4fda70432 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:33.136491 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1090b608-5d98-41a2-a8dd-0ca4fda70432 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:33.137249 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1090b608-5d98-41a2-a8dd-0ca4fda70432 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:33.137679 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1090b608-5d98-41a2-a8dd-0ca4fda70432 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:33.256304 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1090b608-5d98-41a2-a8dd-0ca4fda70432 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:33.263850 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1090b608-5d98-41a2-a8dd-0ca4fda70432 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:33.265323 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1090b608-5d98-41a2-a8dd-0ca4fda70432 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:33.266482 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1090b608-5d98-41a2-a8dd-0ca4fda70432 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1405 microversion: 2.20 time: 0.140931 Oct 28 12:20:33.267077 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 565/1105] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:20:33 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1405 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:20:33.751254 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f5ce3e95-4eaa-439b-9259-622d1d4d0e35 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:33.751885 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f5ce3e95-4eaa-439b-9259-622d1d4d0e35 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:33.757908 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f5ce3e95-4eaa-439b-9259-622d1d4d0e35 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:33.758352 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f5ce3e95-4eaa-439b-9259-622d1d4d0e35 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:33.759290 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f5ce3e95-4eaa-439b-9259-622d1d4d0e35 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:33.759743 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f5ce3e95-4eaa-439b-9259-622d1d4d0e35 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:33.889838 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f5ce3e95-4eaa-439b-9259-622d1d4d0e35 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:33.897497 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f5ce3e95-4eaa-439b-9259-622d1d4d0e35 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1567 microversion: 2.1 time: 0.149753 Oct 28 12:20:33.898077 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 541/1106] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:33 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:34.283835 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2080fe48-707d-4bcd-8f05-e1954fb3af98 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:34.284399 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2080fe48-707d-4bcd-8f05-e1954fb3af98 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:34.290606 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2080fe48-707d-4bcd-8f05-e1954fb3af98 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:34.291067 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2080fe48-707d-4bcd-8f05-e1954fb3af98 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:34.291812 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2080fe48-707d-4bcd-8f05-e1954fb3af98 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:34.292231 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2080fe48-707d-4bcd-8f05-e1954fb3af98 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:34.411070 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2080fe48-707d-4bcd-8f05-e1954fb3af98 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:34.418839 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2080fe48-707d-4bcd-8f05-e1954fb3af98 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:34.421141 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2080fe48-707d-4bcd-8f05-e1954fb3af98 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:34.422226 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2080fe48-707d-4bcd-8f05-e1954fb3af98 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1405 microversion: 2.20 time: 0.142251 Oct 28 12:20:34.422803 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 566/1107] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:20:34 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1405 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:20:34.754947 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b3c77e67-a917-411a-ba0c-4c1885be73c5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-744163973", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-372409146", "security_groups": [{"name": "tempest-secgroup-smoke-1117697042"}], "block_device_mapping_v2": [{"uuid": "6eb51f8a-a31e-4a5a-a265-6d72713a3579", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0274befd-d9a1-4ff6-a2b6-a21e079de445"}]}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:34.848643 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-b3c77e67-a917-411a-ba0c-4c1885be73c5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] validate_networks() for [('0274befd-d9a1-4ff6-a2b6-a21e079de445', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:20:34.914705 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2f617691-1977-48e4-a11d-10573fde58ca tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:34.915320 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2f617691-1977-48e4-a11d-10573fde58ca tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:34.922108 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f617691-1977-48e4-a11d-10573fde58ca tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:34.922555 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f617691-1977-48e4-a11d-10573fde58ca tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:34.923352 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f617691-1977-48e4-a11d-10573fde58ca tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:34.923780 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2f617691-1977-48e4-a11d-10573fde58ca tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:35.051571 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2f617691-1977-48e4-a11d-10573fde58ca tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:35.059021 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2f617691-1977-48e4-a11d-10573fde58ca tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1567 microversion: 2.1 time: 0.147891 Oct 28 12:20:35.059595 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 567/1108] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:34 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:35.209194 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-b3c77e67-a917-411a-ba0c-4c1885be73c5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:20:35.209604 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-b3c77e67-a917-411a-ba0c-4c1885be73c5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:20:35.210066 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-b3c77e67-a917-411a-ba0c-4c1885be73c5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:20:35.210465 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-b3c77e67-a917-411a-ba0c-4c1885be73c5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:20:35.210940 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-b3c77e67-a917-411a-ba0c-4c1885be73c5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:20:35.219963 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3c77e67-a917-411a-ba0c-4c1885be73c5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:35.220415 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3c77e67-a917-411a-ba0c-4c1885be73c5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:35.221263 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3c77e67-a917-411a-ba0c-4c1885be73c5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:35.221718 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b3c77e67-a917-411a-ba0c-4c1885be73c5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:35.237554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-b3c77e67-a917-411a-ba0c-4c1885be73c5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Getting quotas for project cfa9219e414f4bd49dcbf215ed8d6f35. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:20:35.241207 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-b3c77e67-a917-411a-ba0c-4c1885be73c5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Getting quotas for user 9cb6619f170a4a2295b89558706885bc and project cfa9219e414f4bd49dcbf215ed8d6f35. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:20:35.296862 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b3c77e67-a917-411a-ba0c-4c1885be73c5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:20:35.298929 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b3c77e67-a917-411a-ba0c-4c1885be73c5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6eb51f8a-a31e-4a5a-a265-6d72713a3579',volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:20:35.419865 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b3c77e67-a917-411a-ba0c-4c1885be73c5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.668491 Oct 28 12:20:35.420518 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 542/1109] 10.222.0.37 () {60 vars in 1146 bytes} [Thu Oct 28 12:20:34 2021] POST /compute/v2.1/servers => generated 406 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:20:35.431304 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ff05c064-07e0-409c-8a95-b7b4c942df64 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:35.431972 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ff05c064-07e0-409c-8a95-b7b4c942df64 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:35.441689 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cc921ed2-69a2-4435-97a0-db5645ef321c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:35.442634 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cc921ed2-69a2-4435-97a0-db5645ef321c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:35.449873 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cc921ed2-69a2-4435-97a0-db5645ef321c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:35.451111 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cc921ed2-69a2-4435-97a0-db5645ef321c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:35.451917 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cc921ed2-69a2-4435-97a0-db5645ef321c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:35.452361 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cc921ed2-69a2-4435-97a0-db5645ef321c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:35.502757 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ff05c064-07e0-409c-8a95-b7b4c942df64 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:35.509429 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ff05c064-07e0-409c-8a95-b7b4c942df64 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1093 microversion: 2.1 time: 0.082427 Oct 28 12:20:35.511226 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 568/1110] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:35 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1093 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:35.550055 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-6f6488f6-7c94-43e8-8c11-d1d8307daad2 req-75401fe0-3daa-43b3-bce7-a0896b70a0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19635150-a15f-4d59-a3a3-adc15a411e40", "name": "network-vif-plugged", "status": "completed", "tag": "df78786b-91a7-4ab8-9ff2-b69bbf31776f"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:35.552130 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:20:35.552130 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:20:35.563125 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-6f6488f6-7c94-43e8-8c11-d1d8307daad2 req-75401fe0-3daa-43b3-bce7-a0896b70a0f6 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:35.563603 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-6f6488f6-7c94-43e8-8c11-d1d8307daad2 req-75401fe0-3daa-43b3-bce7-a0896b70a0f6 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:35.577578 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-6f6488f6-7c94-43e8-8c11-d1d8307daad2 req-75401fe0-3daa-43b3-bce7-a0896b70a0f6 service nova] Creating event network-vif-plugged:df78786b-91a7-4ab8-9ff2-b69bbf31776f for instance 19635150-a15f-4d59-a3a3-adc15a411e40 on hv-cinder-81571 Oct 28 12:20:35.583664 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-6f6488f6-7c94-43e8-8c11-d1d8307daad2 req-75401fe0-3daa-43b3-bce7-a0896b70a0f6 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038413 Oct 28 12:20:35.584587 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 569/1111] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:20:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:20:35.871062 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cc921ed2-69a2-4435-97a0-db5645ef321c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:35.882259 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cc921ed2-69a2-4435-97a0-db5645ef321c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:35.884024 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cc921ed2-69a2-4435-97a0-db5645ef321c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:35.885141 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cc921ed2-69a2-4435-97a0-db5645ef321c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1405 microversion: 2.20 time: 0.448094 Oct 28 12:20:35.885709 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 543/1112] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:20:35 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1405 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:20:36.076764 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7cd32d23-faf2-4f0a-8123-622f242e5ade tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:36.077450 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7cd32d23-faf2-4f0a-8123-622f242e5ade tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:36.083459 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7cd32d23-faf2-4f0a-8123-622f242e5ade tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:36.083895 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7cd32d23-faf2-4f0a-8123-622f242e5ade tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:36.084647 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7cd32d23-faf2-4f0a-8123-622f242e5ade tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:36.085075 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7cd32d23-faf2-4f0a-8123-622f242e5ade tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:36.217938 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7cd32d23-faf2-4f0a-8123-622f242e5ade tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:36.232315 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7cd32d23-faf2-4f0a-8123-622f242e5ade tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1567 microversion: 2.1 time: 0.159940 Oct 28 12:20:36.233133 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 570/1113] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:36 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:36.527459 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e4884c76-01cc-4a65-8b49-7e11bab73d73 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:36.528065 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e4884c76-01cc-4a65-8b49-7e11bab73d73 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:36.534357 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e4884c76-01cc-4a65-8b49-7e11bab73d73 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:36.534838 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e4884c76-01cc-4a65-8b49-7e11bab73d73 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:36.535611 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e4884c76-01cc-4a65-8b49-7e11bab73d73 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:36.536047 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e4884c76-01cc-4a65-8b49-7e11bab73d73 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:36.595235 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e4884c76-01cc-4a65-8b49-7e11bab73d73 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:36.602804 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e4884c76-01cc-4a65-8b49-7e11bab73d73 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1135 microversion: 2.1 time: 0.078823 Oct 28 12:20:36.603389 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 544/1114] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:36 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1135 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:36.909380 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7adddc57-b5b1-4adc-be56-b7b9bb499054 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:36.910225 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7adddc57-b5b1-4adc-be56-b7b9bb499054 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:36.917995 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7adddc57-b5b1-4adc-be56-b7b9bb499054 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:36.918430 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7adddc57-b5b1-4adc-be56-b7b9bb499054 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:36.919731 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7adddc57-b5b1-4adc-be56-b7b9bb499054 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:36.920483 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7adddc57-b5b1-4adc-be56-b7b9bb499054 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:37.080838 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7adddc57-b5b1-4adc-be56-b7b9bb499054 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:37.091587 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7adddc57-b5b1-4adc-be56-b7b9bb499054 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:37.093089 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7adddc57-b5b1-4adc-be56-b7b9bb499054 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:37.094198 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7adddc57-b5b1-4adc-be56-b7b9bb499054 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1405 microversion: 2.20 time: 0.192915 Oct 28 12:20:37.095156 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 571/1115] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:20:36 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:20:37.252647 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f6e8d58f-9099-4298-a541-1e9cdd71da2e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:37.254336 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f6e8d58f-9099-4298-a541-1e9cdd71da2e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:37.264220 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6e8d58f-9099-4298-a541-1e9cdd71da2e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:37.264220 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6e8d58f-9099-4298-a541-1e9cdd71da2e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:37.264220 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6e8d58f-9099-4298-a541-1e9cdd71da2e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:37.264220 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6e8d58f-9099-4298-a541-1e9cdd71da2e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:37.468581 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f6e8d58f-9099-4298-a541-1e9cdd71da2e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:37.476367 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f6e8d58f-9099-4298-a541-1e9cdd71da2e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1508 microversion: 2.1 time: 0.230765 Oct 28 12:20:37.477195 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 545/1116] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:37 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:37.621178 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8490c0d7-aba0-403d-a3a8-ff26fecedafe tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:37.623484 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8490c0d7-aba0-403d-a3a8-ff26fecedafe tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:37.632861 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8490c0d7-aba0-403d-a3a8-ff26fecedafe tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:37.633559 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8490c0d7-aba0-403d-a3a8-ff26fecedafe tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:37.634796 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8490c0d7-aba0-403d-a3a8-ff26fecedafe tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:37.635575 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8490c0d7-aba0-403d-a3a8-ff26fecedafe tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:37.648645 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-900c9404-5485-491c-af42-d3244c47240e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:37.649294 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-900c9404-5485-491c-af42-d3244c47240e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:37.656015 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-900c9404-5485-491c-af42-d3244c47240e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:37.656534 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-900c9404-5485-491c-af42-d3244c47240e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:37.657375 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-900c9404-5485-491c-af42-d3244c47240e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:37.657871 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-900c9404-5485-491c-af42-d3244c47240e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:37.755251 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8490c0d7-aba0-403d-a3a8-ff26fecedafe tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:37.762977 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8490c0d7-aba0-403d-a3a8-ff26fecedafe tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1209 microversion: 2.1 time: 0.145811 Oct 28 12:20:37.775835 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 546/1117] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:37 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1209 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:37.805244 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: ERROR oslo.messaging._drivers.impl_rabbit [None req-900c9404-5485-491c-af42-d3244c47240e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [5d32f4ef-b8c0-45f5-916b-3683ed24bc69] AMQP server on 10.222.0.37:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 12:20:38.113380 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-11d13a95-294b-4ec8-ac6f-01ea02f44e8b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:38.118746 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-11d13a95-294b-4ec8-ac6f-01ea02f44e8b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:38.125395 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-11d13a95-294b-4ec8-ac6f-01ea02f44e8b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:38.126037 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-11d13a95-294b-4ec8-ac6f-01ea02f44e8b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:38.127016 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-11d13a95-294b-4ec8-ac6f-01ea02f44e8b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:38.127970 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-11d13a95-294b-4ec8-ac6f-01ea02f44e8b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:38.334960 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-11d13a95-294b-4ec8-ac6f-01ea02f44e8b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:38.342539 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-11d13a95-294b-4ec8-ac6f-01ea02f44e8b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:38.344033 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-11d13a95-294b-4ec8-ac6f-01ea02f44e8b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:38.345163 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-11d13a95-294b-4ec8-ac6f-01ea02f44e8b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1596 microversion: 2.20 time: 0.235637 Oct 28 12:20:38.345717 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 547/1118] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:20:38 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1596 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:20:38.362605 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2c52d4d2-8d51-4bd9-9385-a1911dd44672 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:38.363126 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2c52d4d2-8d51-4bd9-9385-a1911dd44672 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:38.368855 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c52d4d2-8d51-4bd9-9385-a1911dd44672 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:38.369296 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c52d4d2-8d51-4bd9-9385-a1911dd44672 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:38.370055 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c52d4d2-8d51-4bd9-9385-a1911dd44672 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:38.370481 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c52d4d2-8d51-4bd9-9385-a1911dd44672 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:38.535995 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2c52d4d2-8d51-4bd9-9385-a1911dd44672 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.176198 Oct 28 12:20:38.542168 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 548/1119] 10.222.0.37 () {60 vars in 1315 bytes} [Thu Oct 28 12:20:38 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:20:38.775503 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-21339bca-bb66-4d9c-9955-f72247b1814a req-38696ecf-50e8-4d49-a869-bb72ca1a9468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99f8b97f-0bb9-426b-939a-83aec5bd97be", "tag": "695c0857-cf64-4a4c-9dc1-67c7d611fbf6"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:38.780566 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:20:38.780566 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:20:38.789096 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-21339bca-bb66-4d9c-9955-f72247b1814a req-38696ecf-50e8-4d49-a869-bb72ca1a9468 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:38.789815 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-21339bca-bb66-4d9c-9955-f72247b1814a req-38696ecf-50e8-4d49-a869-bb72ca1a9468 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:38.811827 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-21339bca-bb66-4d9c-9955-f72247b1814a req-38696ecf-50e8-4d49-a869-bb72ca1a9468 service nova] Creating event network-changed:695c0857-cf64-4a4c-9dc1-67c7d611fbf6 for instance 99f8b97f-0bb9-426b-939a-83aec5bd97be on hv-cinder-81571 Oct 28 12:20:38.820384 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-21339bca-bb66-4d9c-9955-f72247b1814a req-38696ecf-50e8-4d49-a869-bb72ca1a9468 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126527 Oct 28 12:20:38.821876 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 549/1120] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:20:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:20:38.828583 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ab0088bd-f98b-4bdb-9f5c-5b98f6a66e2b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:38.829483 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ab0088bd-f98b-4bdb-9f5c-5b98f6a66e2b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:38.832174 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO oslo.messaging._drivers.impl_rabbit [None req-900c9404-5485-491c-af42-d3244c47240e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [5d32f4ef-b8c0-45f5-916b-3683ed24bc69] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 51682. Oct 28 12:20:38.835372 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-900c9404-5485-491c-af42-d3244c47240e tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "POST /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037/action" status: 202 len: 0 microversion: 2.1 time: 1.345793 Oct 28 12:20:38.843082 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 572/1121] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:20:37 2021] POST /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037/action => generated 0 bytes in 1354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:20:38.848315 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b85c4286-191a-4317-8a8d-57421ab28cb6 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:38.848938 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b85c4286-191a-4317-8a8d-57421ab28cb6 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:38.850205 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ab0088bd-f98b-4bdb-9f5c-5b98f6a66e2b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:38.851256 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ab0088bd-f98b-4bdb-9f5c-5b98f6a66e2b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:38.852961 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ab0088bd-f98b-4bdb-9f5c-5b98f6a66e2b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:38.853593 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ab0088bd-f98b-4bdb-9f5c-5b98f6a66e2b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:38.866099 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b85c4286-191a-4317-8a8d-57421ab28cb6 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:38.866533 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b85c4286-191a-4317-8a8d-57421ab28cb6 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:38.867562 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b85c4286-191a-4317-8a8d-57421ab28cb6 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:38.874841 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b85c4286-191a-4317-8a8d-57421ab28cb6 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:39.108850 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ab0088bd-f98b-4bdb-9f5c-5b98f6a66e2b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:39.119062 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ab0088bd-f98b-4bdb-9f5c-5b98f6a66e2b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1265 microversion: 2.1 time: 0.295915 Oct 28 12:20:39.120301 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 550/1122] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:38 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:39.163972 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b85c4286-191a-4317-8a8d-57421ab28cb6 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:39.174346 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b85c4286-191a-4317-8a8d-57421ab28cb6 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1516 microversion: 2.1 time: 0.330126 Oct 28 12:20:39.186870 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 573/1123] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:38 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1516 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:39.485463 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-55244e8f-2a88-408f-96ad-43caa3c37fa8 req-c5d449af-8ff6-48d2-9244-4fa6de15b505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aa26e71-aa24-4d33-9b9f-96d11867d037", "name": "network-vif-unplugged", "status": "completed", "tag": "6d493e72-8230-488e-974e-b32ede2a9db0"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:39.488165 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:20:39.488165 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:20:39.497028 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-55244e8f-2a88-408f-96ad-43caa3c37fa8 req-c5d449af-8ff6-48d2-9244-4fa6de15b505 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:39.497906 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-55244e8f-2a88-408f-96ad-43caa3c37fa8 req-c5d449af-8ff6-48d2-9244-4fa6de15b505 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:39.510802 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.compute.server_external_events [req-55244e8f-2a88-408f-96ad-43caa3c37fa8 req-c5d449af-8ff6-48d2-9244-4fa6de15b505 service nova] Unable to find a host for instance 8aa26e71-aa24-4d33-9b9f-96d11867d037. Dropping event network-vif-unplugged {{(pid=115797) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 28 12:20:39.511967 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-55244e8f-2a88-408f-96ad-43caa3c37fa8 req-c5d449af-8ff6-48d2-9244-4fa6de15b505 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031878 Oct 28 12:20:39.513540 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 551/1124] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:20:39 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 12:20:40.007226 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-bf88fff9-d9b0-4499-a941-9e8838dc4792 req-2a3fe072-74ae-4a41-b33d-7d2cf0074797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19635150-a15f-4d59-a3a3-adc15a411e40", "tag": "df78786b-91a7-4ab8-9ff2-b69bbf31776f"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:40.008625 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:20:40.008625 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:20:40.015177 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-907690a7-9d91-4a67-8970-efccb262485f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:40.016209 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-907690a7-9d91-4a67-8970-efccb262485f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:40.025752 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-bf88fff9-d9b0-4499-a941-9e8838dc4792 req-2a3fe072-74ae-4a41-b33d-7d2cf0074797 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:40.026193 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-bf88fff9-d9b0-4499-a941-9e8838dc4792 req-2a3fe072-74ae-4a41-b33d-7d2cf0074797 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:40.028997 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-907690a7-9d91-4a67-8970-efccb262485f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:40.029432 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-907690a7-9d91-4a67-8970-efccb262485f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:40.030205 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-907690a7-9d91-4a67-8970-efccb262485f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:40.030625 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-907690a7-9d91-4a67-8970-efccb262485f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:40.043646 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-bf88fff9-d9b0-4499-a941-9e8838dc4792 req-2a3fe072-74ae-4a41-b33d-7d2cf0074797 service nova] Creating event network-changed:df78786b-91a7-4ab8-9ff2-b69bbf31776f for instance 19635150-a15f-4d59-a3a3-adc15a411e40 on hv-cinder-81571 Oct 28 12:20:40.049589 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-bf88fff9-d9b0-4499-a941-9e8838dc4792 req-2a3fe072-74ae-4a41-b33d-7d2cf0074797 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047210 Oct 28 12:20:40.050803 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 552/1125] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:20:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:20:40.121148 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-907690a7-9d91-4a67-8970-efccb262485f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 14 microversion: 2.20 time: 0.119832 Oct 28 12:20:40.122277 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 574/1126] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:20:39 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:40.137749 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1d3d3e3b-0fa2-4ece-84c1-e6c7a465961f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:40.138586 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1d3d3e3b-0fa2-4ece-84c1-e6c7a465961f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:40.146251 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1d3d3e3b-0fa2-4ece-84c1-e6c7a465961f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:40.146980 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1d3d3e3b-0fa2-4ece-84c1-e6c7a465961f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:40.147777 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1d3d3e3b-0fa2-4ece-84c1-e6c7a465961f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:40.148210 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1d3d3e3b-0fa2-4ece-84c1-e6c7a465961f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:40.192889 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-851b1f2c-a664-4b03-95c8-8a8d46c77b22 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:40.193575 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-851b1f2c-a664-4b03-95c8-8a8d46c77b22 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:40.202674 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-851b1f2c-a664-4b03-95c8-8a8d46c77b22 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:40.203230 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-851b1f2c-a664-4b03-95c8-8a8d46c77b22 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:40.204026 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-851b1f2c-a664-4b03-95c8-8a8d46c77b22 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:40.204619 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-851b1f2c-a664-4b03-95c8-8a8d46c77b22 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:40.384484 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-851b1f2c-a664-4b03-95c8-8a8d46c77b22 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:40.387383 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1d3d3e3b-0fa2-4ece-84c1-e6c7a465961f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:40.395006 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-851b1f2c-a664-4b03-95c8-8a8d46c77b22 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1518 microversion: 2.1 time: 0.206158 Oct 28 12:20:40.398767 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 575/1127] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:40 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1518 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:40.399344 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1d3d3e3b-0fa2-4ece-84c1-e6c7a465961f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1265 microversion: 2.1 time: 0.265821 Oct 28 12:20:40.400440 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 553/1128] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:40 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:41.132219 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6066a8d2-89b0-469b-ab88-31f906ae2ff1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:41.133181 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6066a8d2-89b0-469b-ab88-31f906ae2ff1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:41.139499 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6066a8d2-89b0-469b-ab88-31f906ae2ff1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:41.139954 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6066a8d2-89b0-469b-ab88-31f906ae2ff1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:41.140728 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6066a8d2-89b0-469b-ab88-31f906ae2ff1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:41.141161 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6066a8d2-89b0-469b-ab88-31f906ae2ff1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:41.204963 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6066a8d2-89b0-469b-ab88-31f906ae2ff1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 14 microversion: 2.20 time: 0.076530 Oct 28 12:20:41.208083 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 576/1129] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:20:41 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:41.412819 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fcfa9caf-a6ee-4f80-bb1b-94b7f9ef0d3b tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:41.413616 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fcfa9caf-a6ee-4f80-bb1b-94b7f9ef0d3b tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:41.416893 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-420df36e-6b3b-49d0-94bd-b69f65c70e08 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:41.417621 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-420df36e-6b3b-49d0-94bd-b69f65c70e08 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:41.420898 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fcfa9caf-a6ee-4f80-bb1b-94b7f9ef0d3b tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:41.421464 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fcfa9caf-a6ee-4f80-bb1b-94b7f9ef0d3b tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:41.422199 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fcfa9caf-a6ee-4f80-bb1b-94b7f9ef0d3b tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:41.422665 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fcfa9caf-a6ee-4f80-bb1b-94b7f9ef0d3b tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:41.425242 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-420df36e-6b3b-49d0-94bd-b69f65c70e08 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:41.425577 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-420df36e-6b3b-49d0-94bd-b69f65c70e08 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:41.426345 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-420df36e-6b3b-49d0-94bd-b69f65c70e08 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:41.426808 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-420df36e-6b3b-49d0-94bd-b69f65c70e08 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:41.550856 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-420df36e-6b3b-49d0-94bd-b69f65c70e08 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:41.558958 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-420df36e-6b3b-49d0-94bd-b69f65c70e08 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1265 microversion: 2.1 time: 0.145864 Oct 28 12:20:41.559488 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 577/1130] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:41 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:41.625712 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fcfa9caf-a6ee-4f80-bb1b-94b7f9ef0d3b tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:41.633177 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fcfa9caf-a6ee-4f80-bb1b-94b7f9ef0d3b tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1574 microversion: 2.1 time: 0.224139 Oct 28 12:20:41.633746 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 554/1131] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:41 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1574 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:42.215733 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8c09b00d-dcc4-4f0c-a67f-e944d26ccb8d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:42.216629 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8c09b00d-dcc4-4f0c-a67f-e944d26ccb8d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:42.223489 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c09b00d-dcc4-4f0c-a67f-e944d26ccb8d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:42.223933 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c09b00d-dcc4-4f0c-a67f-e944d26ccb8d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:42.224727 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c09b00d-dcc4-4f0c-a67f-e944d26ccb8d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:42.225154 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c09b00d-dcc4-4f0c-a67f-e944d26ccb8d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:42.281815 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8c09b00d-dcc4-4f0c-a67f-e944d26ccb8d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 14 microversion: 2.20 time: 0.069631 Oct 28 12:20:42.282404 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 578/1132] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:20:42 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:42.576167 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8a9df7c1-9815-41ea-bf42-3156b1c70755 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:42.576678 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8a9df7c1-9815-41ea-bf42-3156b1c70755 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:42.582942 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8a9df7c1-9815-41ea-bf42-3156b1c70755 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:42.583390 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8a9df7c1-9815-41ea-bf42-3156b1c70755 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:42.584156 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8a9df7c1-9815-41ea-bf42-3156b1c70755 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:42.584600 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8a9df7c1-9815-41ea-bf42-3156b1c70755 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:42.649929 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5d67d099-73ac-4257-9ae6-67f81f5a1d52 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:42.650617 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5d67d099-73ac-4257-9ae6-67f81f5a1d52 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:42.657608 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5d67d099-73ac-4257-9ae6-67f81f5a1d52 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:42.658050 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5d67d099-73ac-4257-9ae6-67f81f5a1d52 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:42.658853 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5d67d099-73ac-4257-9ae6-67f81f5a1d52 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:42.659279 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5d67d099-73ac-4257-9ae6-67f81f5a1d52 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:42.707828 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-8a9df7c1-9815-41ea-bf42-3156b1c70755 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:42.715348 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8a9df7c1-9815-41ea-bf42-3156b1c70755 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1265 microversion: 2.1 time: 0.143486 Oct 28 12:20:42.715924 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 555/1133] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:42 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:42.786364 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5d67d099-73ac-4257-9ae6-67f81f5a1d52 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:42.794903 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5d67d099-73ac-4257-9ae6-67f81f5a1d52 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1574 microversion: 2.1 time: 0.148182 Oct 28 12:20:42.795471 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 579/1134] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:42 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:43.292321 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8c9987cc-e70a-4f6e-94e6-3e24e2d80c44 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:43.293231 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8c9987cc-e70a-4f6e-94e6-3e24e2d80c44 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:43.300774 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8c9987cc-e70a-4f6e-94e6-3e24e2d80c44 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:43.301626 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8c9987cc-e70a-4f6e-94e6-3e24e2d80c44 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:43.302577 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8c9987cc-e70a-4f6e-94e6-3e24e2d80c44 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:43.303116 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8c9987cc-e70a-4f6e-94e6-3e24e2d80c44 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:43.367425 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8c9987cc-e70a-4f6e-94e6-3e24e2d80c44 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 14 microversion: 2.20 time: 0.078624 Oct 28 12:20:43.370493 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 556/1135] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:20:43 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:43.732437 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-426494f8-13ba-472e-a6fa-4c5972c2749f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:43.733039 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-426494f8-13ba-472e-a6fa-4c5972c2749f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:43.739303 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-426494f8-13ba-472e-a6fa-4c5972c2749f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:43.739747 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-426494f8-13ba-472e-a6fa-4c5972c2749f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:43.740503 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-426494f8-13ba-472e-a6fa-4c5972c2749f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:43.740930 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-426494f8-13ba-472e-a6fa-4c5972c2749f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:43.812138 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a3596662-8fc2-44cd-adbf-2c649096b492 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:43.812831 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a3596662-8fc2-44cd-adbf-2c649096b492 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:43.819620 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a3596662-8fc2-44cd-adbf-2c649096b492 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:43.820068 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a3596662-8fc2-44cd-adbf-2c649096b492 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:43.820843 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a3596662-8fc2-44cd-adbf-2c649096b492 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:43.821273 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a3596662-8fc2-44cd-adbf-2c649096b492 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:43.862130 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-426494f8-13ba-472e-a6fa-4c5972c2749f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:43.870102 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-426494f8-13ba-472e-a6fa-4c5972c2749f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1265 microversion: 2.1 time: 0.141877 Oct 28 12:20:43.870700 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 580/1136] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:43 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:43.947075 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a3596662-8fc2-44cd-adbf-2c649096b492 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:43.954419 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a3596662-8fc2-44cd-adbf-2c649096b492 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1574 microversion: 2.1 time: 0.146384 Oct 28 12:20:43.955026 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 557/1137] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:43 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:44.378736 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-00ddc8de-fe4c-476e-b12c-fa290c4aa6b0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:44.379639 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-00ddc8de-fe4c-476e-b12c-fa290c4aa6b0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:44.385827 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-00ddc8de-fe4c-476e-b12c-fa290c4aa6b0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:44.386263 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-00ddc8de-fe4c-476e-b12c-fa290c4aa6b0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:44.387055 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-00ddc8de-fe4c-476e-b12c-fa290c4aa6b0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:44.387475 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-00ddc8de-fe4c-476e-b12c-fa290c4aa6b0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:44.452360 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-00ddc8de-fe4c-476e-b12c-fa290c4aa6b0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 14 microversion: 2.20 time: 0.077179 Oct 28 12:20:44.453024 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 581/1138] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:20:44 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:44.886868 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a98db4cd-8a75-4376-ba61-8b2e3fb00c2d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:44.887408 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a98db4cd-8a75-4376-ba61-8b2e3fb00c2d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:44.894313 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a98db4cd-8a75-4376-ba61-8b2e3fb00c2d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:44.894830 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a98db4cd-8a75-4376-ba61-8b2e3fb00c2d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:44.895606 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a98db4cd-8a75-4376-ba61-8b2e3fb00c2d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:44.896036 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a98db4cd-8a75-4376-ba61-8b2e3fb00c2d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:44.972857 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6d3545ff-e4d3-4101-89a6-a94d372cbee8 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:44.973537 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6d3545ff-e4d3-4101-89a6-a94d372cbee8 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:44.980384 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6d3545ff-e4d3-4101-89a6-a94d372cbee8 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:44.980819 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6d3545ff-e4d3-4101-89a6-a94d372cbee8 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:44.981575 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6d3545ff-e4d3-4101-89a6-a94d372cbee8 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:44.982029 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6d3545ff-e4d3-4101-89a6-a94d372cbee8 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:45.015943 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a98db4cd-8a75-4376-ba61-8b2e3fb00c2d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:45.023317 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a98db4cd-8a75-4376-ba61-8b2e3fb00c2d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1265 microversion: 2.1 time: 0.140273 Oct 28 12:20:45.023875 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 558/1139] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:44 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:45.106094 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6d3545ff-e4d3-4101-89a6-a94d372cbee8 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:45.113859 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6d3545ff-e4d3-4101-89a6-a94d372cbee8 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1574 microversion: 2.1 time: 0.144983 Oct 28 12:20:45.114430 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 582/1140] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:44 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1574 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:45.463154 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-135b6a9e-8ca9-4f44-9f15-5fd92c485f52 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:45.464126 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-135b6a9e-8ca9-4f44-9f15-5fd92c485f52 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:45.470484 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-135b6a9e-8ca9-4f44-9f15-5fd92c485f52 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:45.470960 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-135b6a9e-8ca9-4f44-9f15-5fd92c485f52 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:45.471760 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-135b6a9e-8ca9-4f44-9f15-5fd92c485f52 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:45.472192 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-135b6a9e-8ca9-4f44-9f15-5fd92c485f52 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:45.575684 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-135b6a9e-8ca9-4f44-9f15-5fd92c485f52 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 14 microversion: 2.20 time: 0.116046 Oct 28 12:20:45.576282 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 559/1141] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:20:45 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:46.039649 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-73811d60-1b7b-48a3-8db6-49643e79a4d7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:46.040260 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-73811d60-1b7b-48a3-8db6-49643e79a4d7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:46.047512 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-73811d60-1b7b-48a3-8db6-49643e79a4d7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:46.047957 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-73811d60-1b7b-48a3-8db6-49643e79a4d7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:46.048729 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-73811d60-1b7b-48a3-8db6-49643e79a4d7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:46.049159 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-73811d60-1b7b-48a3-8db6-49643e79a4d7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:46.131717 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ec23d591-55cb-4f09-aba5-39a7d332cc43 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:46.132415 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ec23d591-55cb-4f09-aba5-39a7d332cc43 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:46.139352 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ec23d591-55cb-4f09-aba5-39a7d332cc43 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:46.139800 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ec23d591-55cb-4f09-aba5-39a7d332cc43 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:46.140579 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ec23d591-55cb-4f09-aba5-39a7d332cc43 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:46.141005 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ec23d591-55cb-4f09-aba5-39a7d332cc43 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:46.173247 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-73811d60-1b7b-48a3-8db6-49643e79a4d7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:46.180472 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-73811d60-1b7b-48a3-8db6-49643e79a4d7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1265 microversion: 2.1 time: 0.144553 Oct 28 12:20:46.181048 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 583/1142] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:46 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:46.262155 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ec23d591-55cb-4f09-aba5-39a7d332cc43 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:46.269625 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ec23d591-55cb-4f09-aba5-39a7d332cc43 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1574 microversion: 2.1 time: 0.141988 Oct 28 12:20:46.270186 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 560/1143] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:46 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1574 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:46.586464 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-82d51fba-1e05-4886-9eb2-52a8d6702067 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:46.587310 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-82d51fba-1e05-4886-9eb2-52a8d6702067 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:46.593546 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-82d51fba-1e05-4886-9eb2-52a8d6702067 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:46.593985 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-82d51fba-1e05-4886-9eb2-52a8d6702067 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:46.594803 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-82d51fba-1e05-4886-9eb2-52a8d6702067 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:46.595232 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-82d51fba-1e05-4886-9eb2-52a8d6702067 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:46.654252 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-82d51fba-1e05-4886-9eb2-52a8d6702067 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 14 microversion: 2.20 time: 0.071260 Oct 28 12:20:46.654932 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 584/1144] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:20:46 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:47.196713 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-78d6d131-b4b2-4dae-afe7-cb09357f78b6 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:47.197318 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-78d6d131-b4b2-4dae-afe7-cb09357f78b6 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:47.205459 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-78d6d131-b4b2-4dae-afe7-cb09357f78b6 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:47.205900 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-78d6d131-b4b2-4dae-afe7-cb09357f78b6 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:47.206655 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-78d6d131-b4b2-4dae-afe7-cb09357f78b6 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:47.207102 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-78d6d131-b4b2-4dae-afe7-cb09357f78b6 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:47.290045 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-eab4be2e-4718-4549-b438-c57d45caac03 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:47.291262 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-eab4be2e-4718-4549-b438-c57d45caac03 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:47.299997 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eab4be2e-4718-4549-b438-c57d45caac03 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:47.300563 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eab4be2e-4718-4549-b438-c57d45caac03 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:47.301541 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eab4be2e-4718-4549-b438-c57d45caac03 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:47.302041 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-eab4be2e-4718-4549-b438-c57d45caac03 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:47.332966 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-78d6d131-b4b2-4dae-afe7-cb09357f78b6 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:47.340450 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-78d6d131-b4b2-4dae-afe7-cb09357f78b6 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1265 microversion: 2.1 time: 0.147315 Oct 28 12:20:47.341028 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 561/1145] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:47 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:47.428749 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-eab4be2e-4718-4549-b438-c57d45caac03 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:47.437050 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-eab4be2e-4718-4549-b438-c57d45caac03 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1574 microversion: 2.1 time: 0.153658 Oct 28 12:20:47.437612 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 585/1146] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:47 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:47.665375 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-63390349-f74c-4c5a-8128-8ff53fe4b5d4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:47.666226 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-63390349-f74c-4c5a-8128-8ff53fe4b5d4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:47.672834 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-63390349-f74c-4c5a-8128-8ff53fe4b5d4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:47.673280 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-63390349-f74c-4c5a-8128-8ff53fe4b5d4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:47.674050 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-63390349-f74c-4c5a-8128-8ff53fe4b5d4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:47.674484 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-63390349-f74c-4c5a-8128-8ff53fe4b5d4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:47.791711 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-63390349-f74c-4c5a-8128-8ff53fe4b5d4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 14 microversion: 2.20 time: 0.129941 Oct 28 12:20:47.792391 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 562/1147] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:20:47 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:48.359041 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b731b48c-dab6-4f6e-985c-6f7cd0632f5e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:48.359559 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b731b48c-dab6-4f6e-985c-6f7cd0632f5e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:48.365760 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b731b48c-dab6-4f6e-985c-6f7cd0632f5e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:48.366201 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b731b48c-dab6-4f6e-985c-6f7cd0632f5e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:48.366992 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b731b48c-dab6-4f6e-985c-6f7cd0632f5e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:48.367418 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b731b48c-dab6-4f6e-985c-6f7cd0632f5e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:48.454239 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-dc730f8c-2fc8-4bd9-bfa2-b715f0f285db tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:48.454960 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-dc730f8c-2fc8-4bd9-bfa2-b715f0f285db tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:48.461738 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dc730f8c-2fc8-4bd9-bfa2-b715f0f285db tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:48.462177 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dc730f8c-2fc8-4bd9-bfa2-b715f0f285db tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:48.462959 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dc730f8c-2fc8-4bd9-bfa2-b715f0f285db tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:48.463387 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dc730f8c-2fc8-4bd9-bfa2-b715f0f285db tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:48.488432 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b731b48c-dab6-4f6e-985c-6f7cd0632f5e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:48.495792 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b731b48c-dab6-4f6e-985c-6f7cd0632f5e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1265 microversion: 2.1 time: 0.141487 Oct 28 12:20:48.496361 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 586/1148] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:48 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:48.583938 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-dc730f8c-2fc8-4bd9-bfa2-b715f0f285db tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:48.591195 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-dc730f8c-2fc8-4bd9-bfa2-b715f0f285db tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1574 microversion: 2.1 time: 0.140889 Oct 28 12:20:48.591763 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 563/1149] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:48 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1574 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:48.803470 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8e4ad9d0-a58b-48ba-9321-7cf9b63b783a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:48.804371 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8e4ad9d0-a58b-48ba-9321-7cf9b63b783a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:48.810505 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8e4ad9d0-a58b-48ba-9321-7cf9b63b783a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:48.810978 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8e4ad9d0-a58b-48ba-9321-7cf9b63b783a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:48.811765 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8e4ad9d0-a58b-48ba-9321-7cf9b63b783a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:48.812245 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8e4ad9d0-a58b-48ba-9321-7cf9b63b783a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:48.872462 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8e4ad9d0-a58b-48ba-9321-7cf9b63b783a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 14 microversion: 2.20 time: 0.072522 Oct 28 12:20:48.873232 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 587/1150] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:20:48 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:49.512423 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-aa318de9-00eb-495c-9be9-ad03f9341f73 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:49.513116 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-aa318de9-00eb-495c-9be9-ad03f9341f73 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:49.519416 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aa318de9-00eb-495c-9be9-ad03f9341f73 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:49.519874 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aa318de9-00eb-495c-9be9-ad03f9341f73 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:49.520902 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aa318de9-00eb-495c-9be9-ad03f9341f73 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:49.521373 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aa318de9-00eb-495c-9be9-ad03f9341f73 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:49.609737 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-95378886-a954-406a-b0ea-82a782bfd985 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:49.610515 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-95378886-a954-406a-b0ea-82a782bfd985 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:49.619631 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-95378886-a954-406a-b0ea-82a782bfd985 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:49.620158 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-95378886-a954-406a-b0ea-82a782bfd985 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:49.620934 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-95378886-a954-406a-b0ea-82a782bfd985 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:49.621359 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-95378886-a954-406a-b0ea-82a782bfd985 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:49.651870 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-aa318de9-00eb-495c-9be9-ad03f9341f73 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:49.660342 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-aa318de9-00eb-495c-9be9-ad03f9341f73 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1265 microversion: 2.1 time: 0.151682 Oct 28 12:20:49.661240 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 564/1151] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:49 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:49.712917 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-bf5780f8-2549-495a-9560-1df35023d259 req-3d18f60e-26c5-43b8-a682-cc2fb9d02ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f8b97f-0bb9-426b-939a-83aec5bd97be", "name": "network-vif-plugged", "status": "completed", "tag": "695c0857-cf64-4a4c-9dc1-67c7d611fbf6"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:49.714595 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:20:49.714595 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:20:49.722724 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-bf5780f8-2549-495a-9560-1df35023d259 req-3d18f60e-26c5-43b8-a682-cc2fb9d02ad3 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:49.723355 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-bf5780f8-2549-495a-9560-1df35023d259 req-3d18f60e-26c5-43b8-a682-cc2fb9d02ad3 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:49.738379 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-bf5780f8-2549-495a-9560-1df35023d259 req-3d18f60e-26c5-43b8-a682-cc2fb9d02ad3 service nova] Creating event network-vif-plugged:695c0857-cf64-4a4c-9dc1-67c7d611fbf6 for instance 99f8b97f-0bb9-426b-939a-83aec5bd97be on hv-cinder-81571 Oct 28 12:20:49.742496 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-bf5780f8-2549-495a-9560-1df35023d259 req-3d18f60e-26c5-43b8-a682-cc2fb9d02ad3 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033356 Oct 28 12:20:49.743577 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 565/1152] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:20:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:20:49.761177 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-95378886-a954-406a-b0ea-82a782bfd985 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:49.769005 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-95378886-a954-406a-b0ea-82a782bfd985 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1574 microversion: 2.1 time: 0.163872 Oct 28 12:20:49.769578 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 588/1153] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:49 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:49.883706 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-13f22117-0c1f-42e6-9790-b1f2871be24b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:49.884717 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-13f22117-0c1f-42e6-9790-b1f2871be24b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:49.891748 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-13f22117-0c1f-42e6-9790-b1f2871be24b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:49.892204 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-13f22117-0c1f-42e6-9790-b1f2871be24b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:49.893138 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-13f22117-0c1f-42e6-9790-b1f2871be24b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:49.893606 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-13f22117-0c1f-42e6-9790-b1f2871be24b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:49.981979 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-13f22117-0c1f-42e6-9790-b1f2871be24b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 14 microversion: 2.20 time: 0.102170 Oct 28 12:20:49.985596 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 566/1154] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:20:49 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:50.677985 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3f49be07-ecfa-4487-ab35-fd06427bca10 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:50.678593 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3f49be07-ecfa-4487-ab35-fd06427bca10 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:50.684936 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3f49be07-ecfa-4487-ab35-fd06427bca10 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:50.685379 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3f49be07-ecfa-4487-ab35-fd06427bca10 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:50.686144 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3f49be07-ecfa-4487-ab35-fd06427bca10 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:50.686575 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3f49be07-ecfa-4487-ab35-fd06427bca10 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:50.786672 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-33b1d138-621f-40da-8a6c-a2e148dd3752 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:50.787403 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-33b1d138-621f-40da-8a6c-a2e148dd3752 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:50.794949 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-33b1d138-621f-40da-8a6c-a2e148dd3752 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:50.795395 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-33b1d138-621f-40da-8a6c-a2e148dd3752 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:50.796186 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-33b1d138-621f-40da-8a6c-a2e148dd3752 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:50.796615 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-33b1d138-621f-40da-8a6c-a2e148dd3752 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:50.922299 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-33b1d138-621f-40da-8a6c-a2e148dd3752 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:50.930289 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-33b1d138-621f-40da-8a6c-a2e148dd3752 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1574 microversion: 2.1 time: 0.147735 Oct 28 12:20:50.931077 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 567/1155] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:50 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:50.960129 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3f49be07-ecfa-4487-ab35-fd06427bca10 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:50.967328 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3f49be07-ecfa-4487-ab35-fd06427bca10 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1265 microversion: 2.1 time: 0.293003 Oct 28 12:20:50.967924 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 589/1156] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:50 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:50.992800 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-aff9fc50-2e29-408b-a62c-0201a5cbadfa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:50.993700 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-aff9fc50-2e29-408b-a62c-0201a5cbadfa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:51.000540 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aff9fc50-2e29-408b-a62c-0201a5cbadfa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:51.000978 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aff9fc50-2e29-408b-a62c-0201a5cbadfa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:51.001732 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aff9fc50-2e29-408b-a62c-0201a5cbadfa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:51.002195 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-aff9fc50-2e29-408b-a62c-0201a5cbadfa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:51.082942 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-aff9fc50-2e29-408b-a62c-0201a5cbadfa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 7248 microversion: 2.20 time: 0.093602 Oct 28 12:20:51.083546 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 568/1157] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:20:50 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 7248 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:20:51.773179 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-ee1b4825-505d-4b3a-868a-a2b49cd0bea4 req-acad291f-f9ea-4117-8edc-397184f685ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aa26e71-aa24-4d33-9b9f-96d11867d037", "name": "network-vif-plugged", "status": "completed", "tag": "6d493e72-8230-488e-974e-b32ede2a9db0"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:51.774733 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:20:51.774733 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:20:51.782429 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-ee1b4825-505d-4b3a-868a-a2b49cd0bea4 req-acad291f-f9ea-4117-8edc-397184f685ad service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:51.782894 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-ee1b4825-505d-4b3a-868a-a2b49cd0bea4 req-acad291f-f9ea-4117-8edc-397184f685ad service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:51.793066 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-ee1b4825-505d-4b3a-868a-a2b49cd0bea4 req-acad291f-f9ea-4117-8edc-397184f685ad service nova] Creating event network-vif-plugged:6d493e72-8230-488e-974e-b32ede2a9db0 for instance 8aa26e71-aa24-4d33-9b9f-96d11867d037 on hv-cinder-81571 Oct 28 12:20:51.798058 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-ee1b4825-505d-4b3a-868a-a2b49cd0bea4 req-acad291f-f9ea-4117-8edc-397184f685ad service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028535 Oct 28 12:20:51.798638 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 590/1158] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:20:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:20:51.950237 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0bdaa607-cc4a-4c90-bc0a-e105a53d7d3a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:51.950991 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0bdaa607-cc4a-4c90-bc0a-e105a53d7d3a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:51.958974 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0bdaa607-cc4a-4c90-bc0a-e105a53d7d3a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:51.959431 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0bdaa607-cc4a-4c90-bc0a-e105a53d7d3a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:51.960207 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0bdaa607-cc4a-4c90-bc0a-e105a53d7d3a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:51.961207 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0bdaa607-cc4a-4c90-bc0a-e105a53d7d3a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:51.984721 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cd9a2741-41f1-4637-9747-11e2391b4afa tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:51.985371 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cd9a2741-41f1-4637-9747-11e2391b4afa tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:51.991542 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cd9a2741-41f1-4637-9747-11e2391b4afa tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:51.991992 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cd9a2741-41f1-4637-9747-11e2391b4afa tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:51.992800 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cd9a2741-41f1-4637-9747-11e2391b4afa tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:51.993232 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cd9a2741-41f1-4637-9747-11e2391b4afa tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:52.118504 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-cd9a2741-41f1-4637-9747-11e2391b4afa tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:52.128515 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cd9a2741-41f1-4637-9747-11e2391b4afa tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1452 microversion: 2.1 time: 0.147871 Oct 28 12:20:52.129214 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 591/1159] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:51 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:20:52.133653 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-504e0c3c-4f1b-474a-b174-292884ebc194 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:52.134831 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-504e0c3c-4f1b-474a-b174-292884ebc194 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:52.141406 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-504e0c3c-4f1b-474a-b174-292884ebc194 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:52.141848 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-504e0c3c-4f1b-474a-b174-292884ebc194 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:52.142610 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-504e0c3c-4f1b-474a-b174-292884ebc194 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:52.143061 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-504e0c3c-4f1b-474a-b174-292884ebc194 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:52.154640 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0bdaa607-cc4a-4c90-bc0a-e105a53d7d3a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:52.162320 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0bdaa607-cc4a-4c90-bc0a-e105a53d7d3a tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1574 microversion: 2.1 time: 0.217638 Oct 28 12:20:52.163014 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 569/1160] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:51 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1574 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:52.167308 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cb9d78ae-c741-4546-95c2-37094ad7f547 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:52.167980 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cb9d78ae-c741-4546-95c2-37094ad7f547 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:52.174186 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb9d78ae-c741-4546-95c2-37094ad7f547 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:52.174634 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb9d78ae-c741-4546-95c2-37094ad7f547 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:52.175477 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb9d78ae-c741-4546-95c2-37094ad7f547 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:52.175916 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cb9d78ae-c741-4546-95c2-37094ad7f547 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:52.295879 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-cb9d78ae-c741-4546-95c2-37094ad7f547 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:52.303675 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cb9d78ae-c741-4546-95c2-37094ad7f547 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1452 microversion: 2.1 time: 0.139727 Oct 28 12:20:52.304257 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 570/1161] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:52 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:52.464213 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-504e0c3c-4f1b-474a-b174-292884ebc194 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 15025 microversion: 2.20 time: 0.333756 Oct 28 12:20:52.465041 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 592/1162] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:20:52 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 15025 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:20:53.180565 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-66e38fb0-52fb-4750-8861-3eb7c2ec19cb tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:53.181167 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-66e38fb0-52fb-4750-8861-3eb7c2ec19cb tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:53.188292 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-66e38fb0-52fb-4750-8861-3eb7c2ec19cb tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:53.188844 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-66e38fb0-52fb-4750-8861-3eb7c2ec19cb tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:53.189627 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-66e38fb0-52fb-4750-8861-3eb7c2ec19cb tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:53.190054 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-66e38fb0-52fb-4750-8861-3eb7c2ec19cb tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:53.476153 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9f8656df-66d4-4ce9-8fbf-8be79ab593ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:53.477168 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9f8656df-66d4-4ce9-8fbf-8be79ab593ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:53.484525 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9f8656df-66d4-4ce9-8fbf-8be79ab593ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:53.484971 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9f8656df-66d4-4ce9-8fbf-8be79ab593ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:53.485733 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9f8656df-66d4-4ce9-8fbf-8be79ab593ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:53.486158 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9f8656df-66d4-4ce9-8fbf-8be79ab593ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:53.491897 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-66e38fb0-52fb-4750-8861-3eb7c2ec19cb tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:53.505708 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-66e38fb0-52fb-4750-8861-3eb7c2ec19cb tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1574 microversion: 2.1 time: 0.329531 Oct 28 12:20:53.506514 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 571/1163] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:53 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1574 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:53.586440 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9f8656df-66d4-4ce9-8fbf-8be79ab593ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 18356 microversion: 2.20 time: 0.114236 Oct 28 12:20:53.587144 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 593/1164] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:20:53 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 18356 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:20:54.235134 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-c533675d-a668-4e42-9b8f-189f43448d26 req-afb8ffaa-1c74-4abe-afbb-6c745ce8929b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99f8b97f-0bb9-426b-939a-83aec5bd97be", "tag": "695c0857-cf64-4a4c-9dc1-67c7d611fbf6"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:54.235134 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:20:54.235134 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:20:54.242034 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-c533675d-a668-4e42-9b8f-189f43448d26 req-afb8ffaa-1c74-4abe-afbb-6c745ce8929b service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:54.242473 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-c533675d-a668-4e42-9b8f-189f43448d26 req-afb8ffaa-1c74-4abe-afbb-6c745ce8929b service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:54.253766 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-c533675d-a668-4e42-9b8f-189f43448d26 req-afb8ffaa-1c74-4abe-afbb-6c745ce8929b service nova] Creating event network-changed:695c0857-cf64-4a4c-9dc1-67c7d611fbf6 for instance 99f8b97f-0bb9-426b-939a-83aec5bd97be on hv-cinder-81571 Oct 28 12:20:54.258624 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-c533675d-a668-4e42-9b8f-189f43448d26 req-afb8ffaa-1c74-4abe-afbb-6c745ce8929b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029730 Oct 28 12:20:54.259416 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 572/1165] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:20:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:20:54.522822 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1b47644c-9dcc-4226-921d-b6731886da87 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:20:54.523503 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1b47644c-9dcc-4226-921d-b6731886da87 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:54.530931 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1b47644c-9dcc-4226-921d-b6731886da87 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:54.531715 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1b47644c-9dcc-4226-921d-b6731886da87 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:54.532673 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1b47644c-9dcc-4226-921d-b6731886da87 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:54.533108 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1b47644c-9dcc-4226-921d-b6731886da87 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:54.598312 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-349da84c-305e-4870-9059-f17516bcc72b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:54.599481 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-349da84c-305e-4870-9059-f17516bcc72b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:54.605953 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-349da84c-305e-4870-9059-f17516bcc72b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:54.606639 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-349da84c-305e-4870-9059-f17516bcc72b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:54.607395 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-349da84c-305e-4870-9059-f17516bcc72b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:54.609964 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-349da84c-305e-4870-9059-f17516bcc72b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:54.669272 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1b47644c-9dcc-4226-921d-b6731886da87 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:20:54.677950 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1b47644c-9dcc-4226-921d-b6731886da87 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1561 microversion: 2.1 time: 0.159000 Oct 28 12:20:54.678605 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 594/1166] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:20:54 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:20:54.710891 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-349da84c-305e-4870-9059-f17516bcc72b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 19342 microversion: 2.20 time: 0.116406 Oct 28 12:20:54.712320 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 573/1167] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:20:54 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 19342 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:20:55.725290 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-db8393d9-b6c9-470b-b420-b266c627cf43 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:55.726942 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-db8393d9-b6c9-470b-b420-b266c627cf43 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:55.735835 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db8393d9-b6c9-470b-b420-b266c627cf43 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:55.736311 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db8393d9-b6c9-470b-b420-b266c627cf43 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:55.737653 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db8393d9-b6c9-470b-b420-b266c627cf43 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:55.738454 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-db8393d9-b6c9-470b-b420-b266c627cf43 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:55.822094 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-db8393d9-b6c9-470b-b420-b266c627cf43 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 21972 microversion: 2.20 time: 0.101683 Oct 28 12:20:55.822723 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 595/1168] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:20:55 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 21972 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:20:56.834405 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-623f209c-5444-4ddd-8891-24988ae06c2f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:56.835462 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-623f209c-5444-4ddd-8891-24988ae06c2f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:56.842261 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-623f209c-5444-4ddd-8891-24988ae06c2f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:56.842747 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-623f209c-5444-4ddd-8891-24988ae06c2f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:56.844083 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-623f209c-5444-4ddd-8891-24988ae06c2f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:56.844517 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-623f209c-5444-4ddd-8891-24988ae06c2f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:56.922810 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-623f209c-5444-4ddd-8891-24988ae06c2f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 23234 microversion: 2.20 time: 0.092114 Oct 28 12:20:56.923333 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 574/1169] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:20:56 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 23234 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:20:57.934538 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-46380f9a-5f0d-49d9-b09b-3e418b57194b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:57.935546 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-46380f9a-5f0d-49d9-b09b-3e418b57194b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:57.942908 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-46380f9a-5f0d-49d9-b09b-3e418b57194b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:57.943357 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-46380f9a-5f0d-49d9-b09b-3e418b57194b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:57.944113 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-46380f9a-5f0d-49d9-b09b-3e418b57194b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:57.944539 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-46380f9a-5f0d-49d9-b09b-3e418b57194b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:58.026414 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-46380f9a-5f0d-49d9-b09b-3e418b57194b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 25047 microversion: 2.20 time: 0.095811 Oct 28 12:20:58.027051 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 596/1170] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:20:57 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 25047 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:20:59.037905 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9536a6cb-5d1c-43f0-842b-036629f944ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:20:59.038864 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9536a6cb-5d1c-43f0-842b-036629f944ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:20:59.045852 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9536a6cb-5d1c-43f0-842b-036629f944ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:59.046827 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9536a6cb-5d1c-43f0-842b-036629f944ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:59.047595 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9536a6cb-5d1c-43f0-842b-036629f944ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:20:59.048022 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9536a6cb-5d1c-43f0-842b-036629f944ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:20:59.121949 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9536a6cb-5d1c-43f0-842b-036629f944ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 26362 microversion: 2.20 time: 0.087991 Oct 28 12:20:59.122721 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 575/1171] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:20:59 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 26362 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:00.133854 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cba02667-d0cc-43bf-96e8-4a4ffa625cd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:00.134863 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cba02667-d0cc-43bf-96e8-4a4ffa625cd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:00.142014 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cba02667-d0cc-43bf-96e8-4a4ffa625cd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:00.142551 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cba02667-d0cc-43bf-96e8-4a4ffa625cd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:00.143507 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cba02667-d0cc-43bf-96e8-4a4ffa625cd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:00.144055 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cba02667-d0cc-43bf-96e8-4a4ffa625cd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:00.236153 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cba02667-d0cc-43bf-96e8-4a4ffa625cd4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 27347 microversion: 2.20 time: 0.106212 Oct 28 12:21:00.236778 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 597/1172] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:00 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 27347 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:01.248353 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e5d04716-8b1d-40ea-8d42-3bcfeeedc1c3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:01.249357 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e5d04716-8b1d-40ea-8d42-3bcfeeedc1c3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:01.256110 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e5d04716-8b1d-40ea-8d42-3bcfeeedc1c3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:01.256552 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e5d04716-8b1d-40ea-8d42-3bcfeeedc1c3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:01.257327 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e5d04716-8b1d-40ea-8d42-3bcfeeedc1c3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:01.257736 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e5d04716-8b1d-40ea-8d42-3bcfeeedc1c3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:01.348795 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e5d04716-8b1d-40ea-8d42-3bcfeeedc1c3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 27761 microversion: 2.20 time: 0.104313 Oct 28 12:21:01.349428 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 576/1173] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:01 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 27761 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:21:02.361126 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-054f0f52-c05f-45cb-84f8-5cd666efe058 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:02.362109 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-054f0f52-c05f-45cb-84f8-5cd666efe058 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:02.368827 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-054f0f52-c05f-45cb-84f8-5cd666efe058 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:02.369262 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-054f0f52-c05f-45cb-84f8-5cd666efe058 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:02.370012 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-054f0f52-c05f-45cb-84f8-5cd666efe058 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:02.370430 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-054f0f52-c05f-45cb-84f8-5cd666efe058 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:02.442207 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-054f0f52-c05f-45cb-84f8-5cd666efe058 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28057 microversion: 2.20 time: 0.085700 Oct 28 12:21:02.442849 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 598/1174] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:02 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28057 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:03.455415 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d20f543f-3316-403b-ae3a-44856520820d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:03.456399 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d20f543f-3316-403b-ae3a-44856520820d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:03.463507 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d20f543f-3316-403b-ae3a-44856520820d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:03.463952 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d20f543f-3316-403b-ae3a-44856520820d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:03.464716 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d20f543f-3316-403b-ae3a-44856520820d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:03.465143 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d20f543f-3316-403b-ae3a-44856520820d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:03.539404 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d20f543f-3316-403b-ae3a-44856520820d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28241 microversion: 2.20 time: 0.088702 Oct 28 12:21:03.540027 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 577/1175] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:03 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:21:04.551437 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b4795cab-b283-40f1-b962-9d902551b5a9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:04.552450 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b4795cab-b283-40f1-b962-9d902551b5a9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:04.559190 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4795cab-b283-40f1-b962-9d902551b5a9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:04.559631 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4795cab-b283-40f1-b962-9d902551b5a9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:04.560384 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4795cab-b283-40f1-b962-9d902551b5a9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:04.560804 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b4795cab-b283-40f1-b962-9d902551b5a9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:04.621312 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b4795cab-b283-40f1-b962-9d902551b5a9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28241 microversion: 2.20 time: 0.073643 Oct 28 12:21:04.621861 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 599/1176] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:04 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:05.633903 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-18335fce-9fa5-43b9-ab4d-5d869cf54770 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:05.634927 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-18335fce-9fa5-43b9-ab4d-5d869cf54770 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:05.641928 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18335fce-9fa5-43b9-ab4d-5d869cf54770 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:05.642370 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18335fce-9fa5-43b9-ab4d-5d869cf54770 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:05.643161 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18335fce-9fa5-43b9-ab4d-5d869cf54770 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:05.643596 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18335fce-9fa5-43b9-ab4d-5d869cf54770 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:05.716775 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-18335fce-9fa5-43b9-ab4d-5d869cf54770 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28241 microversion: 2.20 time: 0.086769 Oct 28 12:21:05.717397 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 578/1177] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:05 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:06.729349 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-63ba3e54-b1ff-403e-8c31-de1a6a061d1e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:06.730342 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-63ba3e54-b1ff-403e-8c31-de1a6a061d1e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:06.737796 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63ba3e54-b1ff-403e-8c31-de1a6a061d1e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:06.738241 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63ba3e54-b1ff-403e-8c31-de1a6a061d1e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:06.739039 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63ba3e54-b1ff-403e-8c31-de1a6a061d1e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:06.739469 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-63ba3e54-b1ff-403e-8c31-de1a6a061d1e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:06.814760 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-63ba3e54-b1ff-403e-8c31-de1a6a061d1e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28241 microversion: 2.20 time: 0.089309 Oct 28 12:21:06.815673 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 600/1178] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:06 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:07.826757 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-53c2ed7f-5edb-4d05-a9de-b905cce88dc8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:07.827777 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-53c2ed7f-5edb-4d05-a9de-b905cce88dc8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:07.834596 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-53c2ed7f-5edb-4d05-a9de-b905cce88dc8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:07.835086 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-53c2ed7f-5edb-4d05-a9de-b905cce88dc8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:07.835843 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-53c2ed7f-5edb-4d05-a9de-b905cce88dc8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:07.836272 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-53c2ed7f-5edb-4d05-a9de-b905cce88dc8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:07.902307 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-53c2ed7f-5edb-4d05-a9de-b905cce88dc8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28241 microversion: 2.20 time: 0.079460 Oct 28 12:21:07.903459 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 579/1179] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:07 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:08.915114 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-70d1803f-dea9-402e-ae41-5872c7ee05ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:08.916043 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-70d1803f-dea9-402e-ae41-5872c7ee05ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:08.923115 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70d1803f-dea9-402e-ae41-5872c7ee05ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:08.923562 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70d1803f-dea9-402e-ae41-5872c7ee05ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:08.924330 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70d1803f-dea9-402e-ae41-5872c7ee05ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:08.924765 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-70d1803f-dea9-402e-ae41-5872c7ee05ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:08.993390 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-70d1803f-dea9-402e-ae41-5872c7ee05ef tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28241 microversion: 2.20 time: 0.082322 Oct 28 12:21:08.994010 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 601/1180] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:08 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:10.006176 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f7db11ef-da7d-4bf8-bd2d-44abca7cd4ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:10.007204 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f7db11ef-da7d-4bf8-bd2d-44abca7cd4ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:10.013973 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f7db11ef-da7d-4bf8-bd2d-44abca7cd4ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:10.015026 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f7db11ef-da7d-4bf8-bd2d-44abca7cd4ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:10.015793 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f7db11ef-da7d-4bf8-bd2d-44abca7cd4ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:10.016226 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f7db11ef-da7d-4bf8-bd2d-44abca7cd4ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:10.079700 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f7db11ef-da7d-4bf8-bd2d-44abca7cd4ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28241 microversion: 2.20 time: 0.077555 Oct 28 12:21:10.080319 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 580/1181] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:10 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:11.091814 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9a7d7510-242c-40ec-83fa-bcb6fc4de95c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:11.093294 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9a7d7510-242c-40ec-83fa-bcb6fc4de95c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:11.100057 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9a7d7510-242c-40ec-83fa-bcb6fc4de95c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:11.100505 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9a7d7510-242c-40ec-83fa-bcb6fc4de95c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:11.101269 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9a7d7510-242c-40ec-83fa-bcb6fc4de95c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:11.101699 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9a7d7510-242c-40ec-83fa-bcb6fc4de95c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:11.172017 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9a7d7510-242c-40ec-83fa-bcb6fc4de95c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28241 microversion: 2.20 time: 0.084114 Oct 28 12:21:11.172637 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 602/1182] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:11 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:12.184436 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-62331711-2474-4445-9ffc-1d6187cb26da tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:12.185430 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-62331711-2474-4445-9ffc-1d6187cb26da tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:12.192215 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-62331711-2474-4445-9ffc-1d6187cb26da tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:12.192660 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-62331711-2474-4445-9ffc-1d6187cb26da tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:12.193432 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-62331711-2474-4445-9ffc-1d6187cb26da tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:12.193864 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-62331711-2474-4445-9ffc-1d6187cb26da tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:12.262530 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-62331711-2474-4445-9ffc-1d6187cb26da tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28241 microversion: 2.20 time: 0.082054 Oct 28 12:21:12.263468 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 581/1183] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:12 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:13.275342 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-06515459-510d-438f-825c-a7beac3936d5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:13.276331 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-06515459-510d-438f-825c-a7beac3936d5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:13.285018 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-06515459-510d-438f-825c-a7beac3936d5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:13.285492 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-06515459-510d-438f-825c-a7beac3936d5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:13.286260 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-06515459-510d-438f-825c-a7beac3936d5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:13.286713 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-06515459-510d-438f-825c-a7beac3936d5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:13.352302 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-06515459-510d-438f-825c-a7beac3936d5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28241 microversion: 2.20 time: 0.080845 Oct 28 12:21:13.353670 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 603/1184] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:13 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:14.364884 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4aeaacb2-48cf-4f7c-8956-2d5d8f35e7f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:14.365872 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4aeaacb2-48cf-4f7c-8956-2d5d8f35e7f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:14.372726 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4aeaacb2-48cf-4f7c-8956-2d5d8f35e7f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:14.373262 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4aeaacb2-48cf-4f7c-8956-2d5d8f35e7f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:14.374747 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4aeaacb2-48cf-4f7c-8956-2d5d8f35e7f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:14.375186 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4aeaacb2-48cf-4f7c-8956-2d5d8f35e7f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:14.441941 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4aeaacb2-48cf-4f7c-8956-2d5d8f35e7f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28241 microversion: 2.20 time: 0.081052 Oct 28 12:21:14.442551 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 582/1185] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:14 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:15.454742 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a017c7f5-aae4-4459-a710-f79e663883c9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:15.455721 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a017c7f5-aae4-4459-a710-f79e663883c9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:15.462371 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a017c7f5-aae4-4459-a710-f79e663883c9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:15.462865 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a017c7f5-aae4-4459-a710-f79e663883c9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:15.463614 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a017c7f5-aae4-4459-a710-f79e663883c9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:15.464043 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a017c7f5-aae4-4459-a710-f79e663883c9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:15.531938 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a017c7f5-aae4-4459-a710-f79e663883c9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28241 microversion: 2.20 time: 0.081980 Oct 28 12:21:15.532522 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 604/1186] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:15 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:16.544708 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f6a8f664-f5e3-4b0a-b507-55841609b483 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:16.546316 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f6a8f664-f5e3-4b0a-b507-55841609b483 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:16.553053 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6a8f664-f5e3-4b0a-b507-55841609b483 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:16.553494 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6a8f664-f5e3-4b0a-b507-55841609b483 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:16.554248 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6a8f664-f5e3-4b0a-b507-55841609b483 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:16.554700 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6a8f664-f5e3-4b0a-b507-55841609b483 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:16.650807 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f6a8f664-f5e3-4b0a-b507-55841609b483 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28531 microversion: 2.20 time: 0.110175 Oct 28 12:21:16.655227 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 583/1187] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:16 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28531 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:17.663880 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3c63b43b-81cf-49f4-8e47-957bc1f3b4fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:17.664926 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3c63b43b-81cf-49f4-8e47-957bc1f3b4fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:17.673088 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c63b43b-81cf-49f4-8e47-957bc1f3b4fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:17.673537 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c63b43b-81cf-49f4-8e47-957bc1f3b4fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:17.674638 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c63b43b-81cf-49f4-8e47-957bc1f3b4fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:17.675106 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c63b43b-81cf-49f4-8e47-957bc1f3b4fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:17.737745 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3c63b43b-81cf-49f4-8e47-957bc1f3b4fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28531 microversion: 2.20 time: 0.078469 Oct 28 12:21:17.738374 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 605/1188] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:17 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28531 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:18.750667 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2dcf5966-bed5-480f-b68a-dc72f503ef0d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:18.751668 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2dcf5966-bed5-480f-b68a-dc72f503ef0d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:18.758526 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2dcf5966-bed5-480f-b68a-dc72f503ef0d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:18.759004 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2dcf5966-bed5-480f-b68a-dc72f503ef0d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:18.759761 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2dcf5966-bed5-480f-b68a-dc72f503ef0d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:18.760187 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2dcf5966-bed5-480f-b68a-dc72f503ef0d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:18.849192 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2dcf5966-bed5-480f-b68a-dc72f503ef0d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.103256 Oct 28 12:21:18.849830 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 584/1189] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:18 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:19.861786 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7dbd7a04-c475-4519-87c4-20508a2fcdd5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:19.862841 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7dbd7a04-c475-4519-87c4-20508a2fcdd5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:19.869701 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7dbd7a04-c475-4519-87c4-20508a2fcdd5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:19.870150 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7dbd7a04-c475-4519-87c4-20508a2fcdd5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:19.870953 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7dbd7a04-c475-4519-87c4-20508a2fcdd5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:19.871388 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7dbd7a04-c475-4519-87c4-20508a2fcdd5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:19.935494 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7dbd7a04-c475-4519-87c4-20508a2fcdd5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.078146 Oct 28 12:21:19.936142 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 606/1190] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:19 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:20.947897 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-90d6cf51-1b42-45fa-a2b1-0a2d02de08b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:20.948803 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-90d6cf51-1b42-45fa-a2b1-0a2d02de08b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:20.955828 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90d6cf51-1b42-45fa-a2b1-0a2d02de08b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:20.956282 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90d6cf51-1b42-45fa-a2b1-0a2d02de08b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:20.957059 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90d6cf51-1b42-45fa-a2b1-0a2d02de08b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:20.957490 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90d6cf51-1b42-45fa-a2b1-0a2d02de08b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:21.021604 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-90d6cf51-1b42-45fa-a2b1-0a2d02de08b1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.077694 Oct 28 12:21:21.022527 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 585/1191] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:20 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:22.033907 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-54890f9a-de9c-44e2-a513-c07e2cbc370c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:22.034918 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-54890f9a-de9c-44e2-a513-c07e2cbc370c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:22.041676 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54890f9a-de9c-44e2-a513-c07e2cbc370c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:22.042118 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54890f9a-de9c-44e2-a513-c07e2cbc370c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:22.042916 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54890f9a-de9c-44e2-a513-c07e2cbc370c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:22.043346 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54890f9a-de9c-44e2-a513-c07e2cbc370c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:22.113438 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-54890f9a-de9c-44e2-a513-c07e2cbc370c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.083718 Oct 28 12:21:22.114100 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 607/1192] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:22 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:23.125680 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2a89f19c-0c33-4ae0-a63d-702328516aaa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:23.126587 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2a89f19c-0c33-4ae0-a63d-702328516aaa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:23.133370 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2a89f19c-0c33-4ae0-a63d-702328516aaa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:23.133813 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2a89f19c-0c33-4ae0-a63d-702328516aaa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:23.134577 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2a89f19c-0c33-4ae0-a63d-702328516aaa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:23.135042 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2a89f19c-0c33-4ae0-a63d-702328516aaa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:23.197197 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2a89f19c-0c33-4ae0-a63d-702328516aaa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.075516 Oct 28 12:21:23.197812 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 586/1193] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:23 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:24.208460 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cab32f87-f1ba-4ac6-8008-04628fac7693 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:24.210125 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cab32f87-f1ba-4ac6-8008-04628fac7693 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:24.219198 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cab32f87-f1ba-4ac6-8008-04628fac7693 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:24.219650 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cab32f87-f1ba-4ac6-8008-04628fac7693 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:24.220511 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cab32f87-f1ba-4ac6-8008-04628fac7693 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:24.223372 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cab32f87-f1ba-4ac6-8008-04628fac7693 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:24.302064 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cab32f87-f1ba-4ac6-8008-04628fac7693 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.097431 Oct 28 12:21:24.302626 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 608/1194] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:24 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:21:25.313931 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-de0270c1-d81d-4deb-803d-c79b66a71c19 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:25.314946 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-de0270c1-d81d-4deb-803d-c79b66a71c19 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:25.321712 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-de0270c1-d81d-4deb-803d-c79b66a71c19 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:25.322158 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-de0270c1-d81d-4deb-803d-c79b66a71c19 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:25.322945 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-de0270c1-d81d-4deb-803d-c79b66a71c19 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:25.323386 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-de0270c1-d81d-4deb-803d-c79b66a71c19 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:25.384141 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-de0270c1-d81d-4deb-803d-c79b66a71c19 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.074694 Oct 28 12:21:25.385041 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 587/1195] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:25 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:26.396715 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bc5f0241-1904-4bce-8fab-44db778c947f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:26.397699 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bc5f0241-1904-4bce-8fab-44db778c947f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:26.404516 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc5f0241-1904-4bce-8fab-44db778c947f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:26.404963 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc5f0241-1904-4bce-8fab-44db778c947f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:26.405726 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc5f0241-1904-4bce-8fab-44db778c947f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:26.406157 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bc5f0241-1904-4bce-8fab-44db778c947f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:26.474305 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bc5f0241-1904-4bce-8fab-44db778c947f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.081581 Oct 28 12:21:26.475339 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 609/1196] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:26 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:21:27.487100 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-380ec040-255c-41de-bca2-957ebb1cd535 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:27.488069 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-380ec040-255c-41de-bca2-957ebb1cd535 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:27.494901 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-380ec040-255c-41de-bca2-957ebb1cd535 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:27.495348 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-380ec040-255c-41de-bca2-957ebb1cd535 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:27.496112 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-380ec040-255c-41de-bca2-957ebb1cd535 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:27.496539 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-380ec040-255c-41de-bca2-957ebb1cd535 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:27.563292 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-380ec040-255c-41de-bca2-957ebb1cd535 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.080785 Oct 28 12:21:27.563898 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 588/1197] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:27 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:21:28.575272 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-439a8fee-cae8-4fc6-90f7-d34a92c70df5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:28.576276 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-439a8fee-cae8-4fc6-90f7-d34a92c70df5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:28.583069 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-439a8fee-cae8-4fc6-90f7-d34a92c70df5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:28.583515 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-439a8fee-cae8-4fc6-90f7-d34a92c70df5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:28.584273 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-439a8fee-cae8-4fc6-90f7-d34a92c70df5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:28.584702 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-439a8fee-cae8-4fc6-90f7-d34a92c70df5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:28.656555 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-439a8fee-cae8-4fc6-90f7-d34a92c70df5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.085169 Oct 28 12:21:28.657173 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 610/1198] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:28 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:29.667604 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b31c5fe7-248f-48c8-9feb-4736fbc0b0f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:29.668887 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b31c5fe7-248f-48c8-9feb-4736fbc0b0f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:29.676332 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b31c5fe7-248f-48c8-9feb-4736fbc0b0f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:29.676770 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b31c5fe7-248f-48c8-9feb-4736fbc0b0f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:29.677528 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b31c5fe7-248f-48c8-9feb-4736fbc0b0f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:29.677948 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b31c5fe7-248f-48c8-9feb-4736fbc0b0f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:29.740325 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b31c5fe7-248f-48c8-9feb-4736fbc0b0f5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.076592 Oct 28 12:21:29.740981 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 589/1199] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:29 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:30.753941 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9c8249e9-a815-4979-af02-5dabedf23792 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:30.754963 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9c8249e9-a815-4979-af02-5dabedf23792 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:30.761794 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9c8249e9-a815-4979-af02-5dabedf23792 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:30.762238 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9c8249e9-a815-4979-af02-5dabedf23792 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:30.763083 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9c8249e9-a815-4979-af02-5dabedf23792 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:30.763461 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9c8249e9-a815-4979-af02-5dabedf23792 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:30.822451 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9c8249e9-a815-4979-af02-5dabedf23792 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.073888 Oct 28 12:21:30.823095 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 611/1200] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:30 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:31.834011 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2883b465-e662-4d15-9465-6d42b02202cd tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:31.835042 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2883b465-e662-4d15-9465-6d42b02202cd tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:31.841922 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2883b465-e662-4d15-9465-6d42b02202cd tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:31.842374 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2883b465-e662-4d15-9465-6d42b02202cd tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:31.843172 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2883b465-e662-4d15-9465-6d42b02202cd tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:31.843612 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2883b465-e662-4d15-9465-6d42b02202cd tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:31.906514 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2883b465-e662-4d15-9465-6d42b02202cd tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.076425 Oct 28 12:21:31.907446 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 590/1201] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:31 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:32.917913 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-59370162-5187-47db-80ea-4507d67dc64c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:32.919171 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-59370162-5187-47db-80ea-4507d67dc64c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:32.926454 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59370162-5187-47db-80ea-4507d67dc64c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:32.926934 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59370162-5187-47db-80ea-4507d67dc64c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:32.927698 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59370162-5187-47db-80ea-4507d67dc64c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:32.928127 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59370162-5187-47db-80ea-4507d67dc64c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:32.990369 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-59370162-5187-47db-80ea-4507d67dc64c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.076470 Oct 28 12:21:32.991027 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 612/1202] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:32 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:34.002946 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2689c75b-419b-4fc1-a1fd-fe04af6de4d3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:34.003942 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2689c75b-419b-4fc1-a1fd-fe04af6de4d3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:34.010663 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2689c75b-419b-4fc1-a1fd-fe04af6de4d3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:34.011147 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2689c75b-419b-4fc1-a1fd-fe04af6de4d3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:34.011907 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2689c75b-419b-4fc1-a1fd-fe04af6de4d3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:34.012333 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2689c75b-419b-4fc1-a1fd-fe04af6de4d3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:34.071428 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2689c75b-419b-4fc1-a1fd-fe04af6de4d3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.073056 Oct 28 12:21:34.072040 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 591/1203] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:33 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:35.083662 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e0dea705-b848-4207-9aae-0cccfeb6a5db tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:35.084582 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e0dea705-b848-4207-9aae-0cccfeb6a5db tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:35.091382 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e0dea705-b848-4207-9aae-0cccfeb6a5db tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:35.091832 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e0dea705-b848-4207-9aae-0cccfeb6a5db tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:35.092603 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e0dea705-b848-4207-9aae-0cccfeb6a5db tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:35.093035 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e0dea705-b848-4207-9aae-0cccfeb6a5db tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:35.163539 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e0dea705-b848-4207-9aae-0cccfeb6a5db tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.083922 Oct 28 12:21:35.164188 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 613/1204] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:35 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:36.177001 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-042cff83-4244-4a71-b55e-88feb5742c38 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:36.177988 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-042cff83-4244-4a71-b55e-88feb5742c38 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:36.184819 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-042cff83-4244-4a71-b55e-88feb5742c38 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:36.185260 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-042cff83-4244-4a71-b55e-88feb5742c38 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:36.186021 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-042cff83-4244-4a71-b55e-88feb5742c38 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:36.186450 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-042cff83-4244-4a71-b55e-88feb5742c38 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:36.247516 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-042cff83-4244-4a71-b55e-88feb5742c38 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.074728 Oct 28 12:21:36.248363 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 592/1205] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:36 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:36.609043 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ab1198ad-2ae9-4aeb-9760-e717b4dcca0f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:21:36.609614 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ab1198ad-2ae9-4aeb-9760-e717b4dcca0f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:36.617436 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ab1198ad-2ae9-4aeb-9760-e717b4dcca0f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:36.617878 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ab1198ad-2ae9-4aeb-9760-e717b4dcca0f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:36.618649 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ab1198ad-2ae9-4aeb-9760-e717b4dcca0f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:36.619111 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ab1198ad-2ae9-4aeb-9760-e717b4dcca0f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:36.695445 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-ab1198ad-2ae9-4aeb-9760-e717b4dcca0f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lazy-loading 'services' on Instance uuid e3cfb902-8c2c-4a98-b226-147d495a83e9 {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:21:36.763940 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ab1198ad-2ae9-4aeb-9760-e717b4dcca0f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/os-volume_attachments/88f894a4-a535-4e65-b715-11b0e8f75cdb" status: 202 len: 0 microversion: 2.1 time: 0.158906 Oct 28 12:21:36.764608 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 614/1206] 10.222.0.37 () {58 vars in 1415 bytes} [Thu Oct 28 12:21:36 2021] DELETE /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/os-volume_attachments/88f894a4-a535-4e65-b715-11b0e8f75cdb => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:37.258947 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-136527c6-0d39-41d4-acc4-a4232a59d1ec tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:37.259934 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-136527c6-0d39-41d4-acc4-a4232a59d1ec tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:37.267276 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-136527c6-0d39-41d4-acc4-a4232a59d1ec tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:37.267730 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-136527c6-0d39-41d4-acc4-a4232a59d1ec tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:37.268493 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-136527c6-0d39-41d4-acc4-a4232a59d1ec tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:37.268925 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-136527c6-0d39-41d4-acc4-a4232a59d1ec tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:37.339827 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-136527c6-0d39-41d4-acc4-a4232a59d1ec tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.084947 Oct 28 12:21:37.340496 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 593/1207] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:37 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:37.870867 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-369a984f-2515-4225-8a73-359c906e36d5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:37.877078 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-369a984f-2515-4225-8a73-359c906e36d5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:37.877525 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-369a984f-2515-4225-8a73-359c906e36d5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:37.898715 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-369a984f-2515-4225-8a73-359c906e36d5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Going to try to stop instance {{(pid=115798) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 28 12:21:37.941650 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-369a984f-2515-4225-8a73-359c906e36d5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 202 len: 0 microversion: 2.1 time: 0.075154 Oct 28 12:21:37.942370 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 615/1208] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:21:37 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:37.951042 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fac5190e-44c4-4d7d-8946-9ed1326abcd3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:21:37.952253 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fac5190e-44c4-4d7d-8946-9ed1326abcd3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:37.958980 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fac5190e-44c4-4d7d-8946-9ed1326abcd3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:37.959414 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fac5190e-44c4-4d7d-8946-9ed1326abcd3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:37.960366 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fac5190e-44c4-4d7d-8946-9ed1326abcd3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:37.960909 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fac5190e-44c4-4d7d-8946-9ed1326abcd3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:38.081630 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-fac5190e-44c4-4d7d-8946-9ed1326abcd3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:21:38.088911 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fac5190e-44c4-4d7d-8946-9ed1326abcd3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1674 microversion: 2.1 time: 0.142126 Oct 28 12:21:38.089470 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 594/1209] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:21:37 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1674 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:21:38.352617 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-99fe8f89-36e3-4738-99b3-25a4adfa45dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:38.353586 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-99fe8f89-36e3-4738-99b3-25a4adfa45dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:38.360187 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-99fe8f89-36e3-4738-99b3-25a4adfa45dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:38.360616 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-99fe8f89-36e3-4738-99b3-25a4adfa45dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:38.361382 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-99fe8f89-36e3-4738-99b3-25a4adfa45dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:38.361813 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-99fe8f89-36e3-4738-99b3-25a4adfa45dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:38.425767 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-99fe8f89-36e3-4738-99b3-25a4adfa45dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.077136 Oct 28 12:21:38.426374 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 616/1210] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:38 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:39.106890 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-29e8b461-1ad2-4e4c-9a55-7fc80bab15f6 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:21:39.107594 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-29e8b461-1ad2-4e4c-9a55-7fc80bab15f6 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:39.114448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29e8b461-1ad2-4e4c-9a55-7fc80bab15f6 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:39.114925 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29e8b461-1ad2-4e4c-9a55-7fc80bab15f6 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:39.115723 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29e8b461-1ad2-4e4c-9a55-7fc80bab15f6 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:39.116156 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29e8b461-1ad2-4e4c-9a55-7fc80bab15f6 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:39.233033 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-29e8b461-1ad2-4e4c-9a55-7fc80bab15f6 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:21:39.241442 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-29e8b461-1ad2-4e4c-9a55-7fc80bab15f6 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1674 microversion: 2.1 time: 0.138344 Oct 28 12:21:39.241998 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 595/1211] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:21:39 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1674 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:21:39.437899 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b403d7ba-8d06-4dc5-9469-5d54a0f60c88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:39.438903 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b403d7ba-8d06-4dc5-9469-5d54a0f60c88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:39.445610 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b403d7ba-8d06-4dc5-9469-5d54a0f60c88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:39.446049 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b403d7ba-8d06-4dc5-9469-5d54a0f60c88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:39.446823 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b403d7ba-8d06-4dc5-9469-5d54a0f60c88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:39.447248 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b403d7ba-8d06-4dc5-9469-5d54a0f60c88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:39.518476 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b403d7ba-8d06-4dc5-9469-5d54a0f60c88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.084484 Oct 28 12:21:39.519129 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 617/1212] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:39 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:21:40.258219 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2128e190-ed3f-4987-8df1-12a74a6d96de tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:21:40.258830 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2128e190-ed3f-4987-8df1-12a74a6d96de tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:40.265698 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2128e190-ed3f-4987-8df1-12a74a6d96de tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:40.266140 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2128e190-ed3f-4987-8df1-12a74a6d96de tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:40.266932 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2128e190-ed3f-4987-8df1-12a74a6d96de tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:40.267360 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2128e190-ed3f-4987-8df1-12a74a6d96de tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:40.393133 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2128e190-ed3f-4987-8df1-12a74a6d96de tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:21:40.400319 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2128e190-ed3f-4987-8df1-12a74a6d96de tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1674 microversion: 2.1 time: 0.145786 Oct 28 12:21:40.400892 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 596/1213] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:21:40 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:21:40.531001 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f1ad811e-48a5-4b16-b47d-a3ed1ae228ff tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:40.531947 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f1ad811e-48a5-4b16-b47d-a3ed1ae228ff tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:40.538762 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f1ad811e-48a5-4b16-b47d-a3ed1ae228ff tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:40.539220 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f1ad811e-48a5-4b16-b47d-a3ed1ae228ff tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:40.539987 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f1ad811e-48a5-4b16-b47d-a3ed1ae228ff tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:40.540417 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f1ad811e-48a5-4b16-b47d-a3ed1ae228ff tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:40.603070 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f1ad811e-48a5-4b16-b47d-a3ed1ae228ff tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.076521 Oct 28 12:21:40.603708 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 618/1214] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:40 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:41.417496 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9bc07ff9-499d-440a-895a-3425ef8c1e6d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:21:41.418127 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9bc07ff9-499d-440a-895a-3425ef8c1e6d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:41.425473 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9bc07ff9-499d-440a-895a-3425ef8c1e6d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:41.425940 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9bc07ff9-499d-440a-895a-3425ef8c1e6d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:41.426664 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9bc07ff9-499d-440a-895a-3425ef8c1e6d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:41.427112 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9bc07ff9-499d-440a-895a-3425ef8c1e6d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:41.544173 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9bc07ff9-499d-440a-895a-3425ef8c1e6d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:21:41.551833 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9bc07ff9-499d-440a-895a-3425ef8c1e6d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1674 microversion: 2.1 time: 0.137948 Oct 28 12:21:41.552392 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 597/1215] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:21:41 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1674 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:21:41.615638 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bbdaf025-f5d6-4b56-b872-24bddc0028ab tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:41.616637 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-bbdaf025-f5d6-4b56-b872-24bddc0028ab tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:41.623546 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bbdaf025-f5d6-4b56-b872-24bddc0028ab tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:41.623999 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bbdaf025-f5d6-4b56-b872-24bddc0028ab tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:41.624773 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bbdaf025-f5d6-4b56-b872-24bddc0028ab tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:41.625215 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-bbdaf025-f5d6-4b56-b872-24bddc0028ab tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:41.688971 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bbdaf025-f5d6-4b56-b872-24bddc0028ab tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.077126 Oct 28 12:21:41.689525 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 619/1216] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:41 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:42.568470 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a7772de5-1f20-4a20-9ca7-52c4ad33147f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:21:42.569088 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a7772de5-1f20-4a20-9ca7-52c4ad33147f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:42.575348 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a7772de5-1f20-4a20-9ca7-52c4ad33147f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:42.575788 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a7772de5-1f20-4a20-9ca7-52c4ad33147f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:42.576553 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a7772de5-1f20-4a20-9ca7-52c4ad33147f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:42.577477 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a7772de5-1f20-4a20-9ca7-52c4ad33147f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:42.702897 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a7772de5-1f20-4a20-9ca7-52c4ad33147f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:21:42.706592 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4bdbfde1-c7ae-4f8e-9ba4-bc467ba0429a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:42.708273 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4bdbfde1-c7ae-4f8e-9ba4-bc467ba0429a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:42.710554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a7772de5-1f20-4a20-9ca7-52c4ad33147f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1674 microversion: 2.1 time: 0.145711 Oct 28 12:21:42.711160 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 598/1217] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:21:42 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:21:42.715558 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4bdbfde1-c7ae-4f8e-9ba4-bc467ba0429a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:42.716204 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4bdbfde1-c7ae-4f8e-9ba4-bc467ba0429a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:42.717000 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4bdbfde1-c7ae-4f8e-9ba4-bc467ba0429a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:42.718352 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4bdbfde1-c7ae-4f8e-9ba4-bc467ba0429a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:42.782319 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4bdbfde1-c7ae-4f8e-9ba4-bc467ba0429a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.084810 Oct 28 12:21:42.782977 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 620/1218] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:42 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:21:43.729959 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5c61f4c7-94d2-40fd-8e1f-1424ca2b4d5a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:21:43.731834 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5c61f4c7-94d2-40fd-8e1f-1424ca2b4d5a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:43.737262 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5c61f4c7-94d2-40fd-8e1f-1424ca2b4d5a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:43.737709 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5c61f4c7-94d2-40fd-8e1f-1424ca2b4d5a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:43.738483 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5c61f4c7-94d2-40fd-8e1f-1424ca2b4d5a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:43.739035 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5c61f4c7-94d2-40fd-8e1f-1424ca2b4d5a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:43.794522 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-62ae90a5-bfae-47e3-8fdc-49c3fe21ae3c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:43.795567 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-62ae90a5-bfae-47e3-8fdc-49c3fe21ae3c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:43.803103 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-62ae90a5-bfae-47e3-8fdc-49c3fe21ae3c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:43.803548 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-62ae90a5-bfae-47e3-8fdc-49c3fe21ae3c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:43.804320 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-62ae90a5-bfae-47e3-8fdc-49c3fe21ae3c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:43.804747 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-62ae90a5-bfae-47e3-8fdc-49c3fe21ae3c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:43.862887 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5c61f4c7-94d2-40fd-8e1f-1424ca2b4d5a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:21:43.870269 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5c61f4c7-94d2-40fd-8e1f-1424ca2b4d5a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1674 microversion: 2.1 time: 0.143969 Oct 28 12:21:43.870865 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 599/1219] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:21:43 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1674 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:21:43.877832 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-62ae90a5-bfae-47e3-8fdc-49c3fe21ae3c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.087344 Oct 28 12:21:43.879112 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 621/1220] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:43 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:21:44.887415 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c7b31f23-84c5-43f0-a5a8-97a9f5e7cff3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:21:44.888030 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c7b31f23-84c5-43f0-a5a8-97a9f5e7cff3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:44.889685 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3c076e34-1c71-4c1c-8198-ea65f95198ab tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:44.890660 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3c076e34-1c71-4c1c-8198-ea65f95198ab tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:44.894376 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7b31f23-84c5-43f0-a5a8-97a9f5e7cff3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:44.894864 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7b31f23-84c5-43f0-a5a8-97a9f5e7cff3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:44.895645 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7b31f23-84c5-43f0-a5a8-97a9f5e7cff3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:44.896100 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7b31f23-84c5-43f0-a5a8-97a9f5e7cff3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:44.897406 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c076e34-1c71-4c1c-8198-ea65f95198ab tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:44.897848 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c076e34-1c71-4c1c-8198-ea65f95198ab tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:44.898605 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c076e34-1c71-4c1c-8198-ea65f95198ab tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:44.899074 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3c076e34-1c71-4c1c-8198-ea65f95198ab tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:44.963226 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3c076e34-1c71-4c1c-8198-ea65f95198ab tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.077281 Oct 28 12:21:44.967311 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 622/1221] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:44 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:21:45.015584 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c7b31f23-84c5-43f0-a5a8-97a9f5e7cff3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:21:45.022790 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c7b31f23-84c5-43f0-a5a8-97a9f5e7cff3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1674 microversion: 2.1 time: 0.139441 Oct 28 12:21:45.023370 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 600/1222] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:21:44 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1674 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:21:45.975643 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-93271ae4-0d20-4b96-8fbe-0a936f413d95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:45.976632 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-93271ae4-0d20-4b96-8fbe-0a936f413d95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:45.983532 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-93271ae4-0d20-4b96-8fbe-0a936f413d95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:45.983975 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-93271ae4-0d20-4b96-8fbe-0a936f413d95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:45.984740 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-93271ae4-0d20-4b96-8fbe-0a936f413d95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:45.985169 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-93271ae4-0d20-4b96-8fbe-0a936f413d95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:46.039827 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-29f1d597-d9d8-42c5-a382-3e1c5a8560c0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:21:46.040459 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-29f1d597-d9d8-42c5-a382-3e1c5a8560c0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:46.047282 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29f1d597-d9d8-42c5-a382-3e1c5a8560c0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:46.047727 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29f1d597-d9d8-42c5-a382-3e1c5a8560c0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:46.048494 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29f1d597-d9d8-42c5-a382-3e1c5a8560c0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:46.048925 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-29f1d597-d9d8-42c5-a382-3e1c5a8560c0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:46.049164 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-93271ae4-0d20-4b96-8fbe-0a936f413d95 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.077503 Oct 28 12:21:46.051256 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 623/1223] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:45 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:21:46.167548 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-29f1d597-d9d8-42c5-a382-3e1c5a8560c0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:21:46.174998 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-29f1d597-d9d8-42c5-a382-3e1c5a8560c0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1674 microversion: 2.1 time: 0.138740 Oct 28 12:21:46.175596 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 601/1224] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:21:46 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1674 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:21:47.062295 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-54f0d49c-57b6-4fff-8708-1db900076e88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:47.063237 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-54f0d49c-57b6-4fff-8708-1db900076e88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:47.069997 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54f0d49c-57b6-4fff-8708-1db900076e88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:47.070434 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54f0d49c-57b6-4fff-8708-1db900076e88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:47.071249 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54f0d49c-57b6-4fff-8708-1db900076e88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:47.071673 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-54f0d49c-57b6-4fff-8708-1db900076e88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:47.133910 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-54f0d49c-57b6-4fff-8708-1db900076e88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.076500 Oct 28 12:21:47.134520 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 624/1225] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:47 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:21:47.192208 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7598d942-cefb-429f-aa4a-9862fb60f5fb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:21:47.192816 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7598d942-cefb-429f-aa4a-9862fb60f5fb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:47.199016 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7598d942-cefb-429f-aa4a-9862fb60f5fb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:47.199464 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7598d942-cefb-429f-aa4a-9862fb60f5fb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:47.200229 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7598d942-cefb-429f-aa4a-9862fb60f5fb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:47.200661 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7598d942-cefb-429f-aa4a-9862fb60f5fb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:47.323267 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7598d942-cefb-429f-aa4a-9862fb60f5fb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:21:47.330387 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7598d942-cefb-429f-aa4a-9862fb60f5fb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1674 microversion: 2.1 time: 0.141820 Oct 28 12:21:47.330980 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 602/1226] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:21:47 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1674 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:21:48.146542 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ed292155-dc14-43ab-a97b-be385281a12b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:48.147570 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ed292155-dc14-43ab-a97b-be385281a12b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:48.154364 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ed292155-dc14-43ab-a97b-be385281a12b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:48.154848 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ed292155-dc14-43ab-a97b-be385281a12b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:48.155614 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ed292155-dc14-43ab-a97b-be385281a12b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:48.156044 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ed292155-dc14-43ab-a97b-be385281a12b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:48.219256 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ed292155-dc14-43ab-a97b-be385281a12b tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.077217 Oct 28 12:21:48.219885 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 625/1227] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:48 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:48.347102 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7d6de493-2b09-4929-b42e-56144782fb57 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:21:48.347710 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7d6de493-2b09-4929-b42e-56144782fb57 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:48.353855 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7d6de493-2b09-4929-b42e-56144782fb57 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:48.354301 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7d6de493-2b09-4929-b42e-56144782fb57 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:48.355130 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7d6de493-2b09-4929-b42e-56144782fb57 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:48.355571 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7d6de493-2b09-4929-b42e-56144782fb57 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:48.473886 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7d6de493-2b09-4929-b42e-56144782fb57 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:21:48.481044 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7d6de493-2b09-4929-b42e-56144782fb57 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1651 microversion: 2.1 time: 0.137726 Oct 28 12:21:48.481805 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 603/1228] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:21:48 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1651 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:21:48.497931 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8fc7333c-cf8b-4ac5-859a-b241c12a2f8a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:48.505345 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8fc7333c-cf8b-4ac5-859a-b241c12a2f8a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:48.505787 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8fc7333c-cf8b-4ac5-859a-b241c12a2f8a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:48.526830 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8fc7333c-cf8b-4ac5-859a-b241c12a2f8a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Going to try to start instance {{(pid=115798) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 28 12:21:48.567413 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8fc7333c-cf8b-4ac5-859a-b241c12a2f8a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action" status: 202 len: 0 microversion: 2.1 time: 0.073198 Oct 28 12:21:48.568000 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 626/1229] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:21:48 2021] POST /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:48.576006 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9ac36ab9-f845-494d-80aa-296ddf7e3dcc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:21:48.576609 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9ac36ab9-f845-494d-80aa-296ddf7e3dcc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:48.582949 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9ac36ab9-f845-494d-80aa-296ddf7e3dcc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:48.583507 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9ac36ab9-f845-494d-80aa-296ddf7e3dcc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:48.584541 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9ac36ab9-f845-494d-80aa-296ddf7e3dcc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:48.585008 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9ac36ab9-f845-494d-80aa-296ddf7e3dcc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:48.739944 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9ac36ab9-f845-494d-80aa-296ddf7e3dcc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:21:48.747220 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9ac36ab9-f845-494d-80aa-296ddf7e3dcc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1660 microversion: 2.1 time: 0.174894 Oct 28 12:21:48.747798 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 604/1230] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:21:48 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1660 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:21:49.232302 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d83fccf8-594a-4e09-bac8-9468b40c3585 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:49.233425 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d83fccf8-594a-4e09-bac8-9468b40c3585 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:49.239431 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d83fccf8-594a-4e09-bac8-9468b40c3585 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:49.239878 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d83fccf8-594a-4e09-bac8-9468b40c3585 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:49.240642 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d83fccf8-594a-4e09-bac8-9468b40c3585 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:49.241070 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d83fccf8-594a-4e09-bac8-9468b40c3585 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:49.305088 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d83fccf8-594a-4e09-bac8-9468b40c3585 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.077147 Oct 28 12:21:49.305739 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 627/1231] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:49 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:49.765174 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d6b5886e-b108-48f8-a4ba-395659bb3060 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:21:49.765781 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d6b5886e-b108-48f8-a4ba-395659bb3060 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:49.772586 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d6b5886e-b108-48f8-a4ba-395659bb3060 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:49.773038 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d6b5886e-b108-48f8-a4ba-395659bb3060 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:49.773820 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d6b5886e-b108-48f8-a4ba-395659bb3060 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:49.774252 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d6b5886e-b108-48f8-a4ba-395659bb3060 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:49.901144 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d6b5886e-b108-48f8-a4ba-395659bb3060 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:21:49.908479 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d6b5886e-b108-48f8-a4ba-395659bb3060 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1660 microversion: 2.1 time: 0.147088 Oct 28 12:21:49.909045 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 605/1232] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:21:49 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1660 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:21:50.316591 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-dc76df82-e478-4217-8a60-5b0446048762 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:50.317579 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-dc76df82-e478-4217-8a60-5b0446048762 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:50.324576 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc76df82-e478-4217-8a60-5b0446048762 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:50.325047 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc76df82-e478-4217-8a60-5b0446048762 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:50.325823 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc76df82-e478-4217-8a60-5b0446048762 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:50.326247 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-dc76df82-e478-4217-8a60-5b0446048762 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:50.397483 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-dc76df82-e478-4217-8a60-5b0446048762 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.084937 Oct 28 12:21:50.398108 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 628/1233] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:50 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:50.926180 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f9494fb6-2d60-4706-9119-c28946cdbe8e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:21:50.926744 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f9494fb6-2d60-4706-9119-c28946cdbe8e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:50.933310 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f9494fb6-2d60-4706-9119-c28946cdbe8e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:50.933887 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f9494fb6-2d60-4706-9119-c28946cdbe8e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:50.934659 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f9494fb6-2d60-4706-9119-c28946cdbe8e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:50.935110 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f9494fb6-2d60-4706-9119-c28946cdbe8e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:51.057067 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f9494fb6-2d60-4706-9119-c28946cdbe8e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:21:51.064248 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f9494fb6-2d60-4706-9119-c28946cdbe8e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1664 microversion: 2.1 time: 0.141810 Oct 28 12:21:51.064822 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 606/1234] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:21:50 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1664 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:21:51.410006 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8a07e2a5-ff5f-4c29-820c-04781de3b753 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:51.411033 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8a07e2a5-ff5f-4c29-820c-04781de3b753 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:51.417908 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a07e2a5-ff5f-4c29-820c-04781de3b753 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:51.418352 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a07e2a5-ff5f-4c29-820c-04781de3b753 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:51.419403 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a07e2a5-ff5f-4c29-820c-04781de3b753 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:51.419831 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a07e2a5-ff5f-4c29-820c-04781de3b753 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:51.480812 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8a07e2a5-ff5f-4c29-820c-04781de3b753 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 28699 microversion: 2.20 time: 0.075333 Oct 28 12:21:51.481435 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 629/1235] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:51 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 28699 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:21:52.492162 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fae69f74-aa7e-4e33-aaa1-91037f20d95f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:52.493125 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fae69f74-aa7e-4e33-aaa1-91037f20d95f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:52.499412 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fae69f74-aa7e-4e33-aaa1-91037f20d95f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:52.499862 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fae69f74-aa7e-4e33-aaa1-91037f20d95f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:52.500628 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fae69f74-aa7e-4e33-aaa1-91037f20d95f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:52.501093 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fae69f74-aa7e-4e33-aaa1-91037f20d95f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:52.576098 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fae69f74-aa7e-4e33-aaa1-91037f20d95f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 30185 microversion: 2.20 time: 0.087490 Oct 28 12:21:52.576714 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 607/1236] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:52 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 30185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:53.588028 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f33ebff2-6b70-4d0e-99d7-4101c4b6c56f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:53.589025 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f33ebff2-6b70-4d0e-99d7-4101c4b6c56f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:53.595960 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f33ebff2-6b70-4d0e-99d7-4101c4b6c56f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:53.596404 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f33ebff2-6b70-4d0e-99d7-4101c4b6c56f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:53.597877 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f33ebff2-6b70-4d0e-99d7-4101c4b6c56f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:53.598314 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f33ebff2-6b70-4d0e-99d7-4101c4b6c56f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:53.674992 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f33ebff2-6b70-4d0e-99d7-4101c4b6c56f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 31890 microversion: 2.20 time: 0.090897 Oct 28 12:21:53.675863 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 630/1237] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:53 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 31890 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:54.687100 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-991b9ccc-de40-4aa9-9a2a-5f5f121eaaf1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:54.688098 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-991b9ccc-de40-4aa9-9a2a-5f5f121eaaf1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:54.696132 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-991b9ccc-de40-4aa9-9a2a-5f5f121eaaf1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:54.696759 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-991b9ccc-de40-4aa9-9a2a-5f5f121eaaf1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:54.697545 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-991b9ccc-de40-4aa9-9a2a-5f5f121eaaf1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:54.697981 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-991b9ccc-de40-4aa9-9a2a-5f5f121eaaf1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:54.775636 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-991b9ccc-de40-4aa9-9a2a-5f5f121eaaf1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 33251 microversion: 2.20 time: 0.092417 Oct 28 12:21:54.777080 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 608/1238] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:54 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 33251 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:55.787833 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-77885c9e-3728-4a6a-8190-cd67e31b78bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:55.788810 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-77885c9e-3728-4a6a-8190-cd67e31b78bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:55.795832 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77885c9e-3728-4a6a-8190-cd67e31b78bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:55.796270 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77885c9e-3728-4a6a-8190-cd67e31b78bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:55.797026 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77885c9e-3728-4a6a-8190-cd67e31b78bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:55.797453 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77885c9e-3728-4a6a-8190-cd67e31b78bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:55.874928 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-77885c9e-3728-4a6a-8190-cd67e31b78bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 34039 microversion: 2.20 time: 0.090952 Oct 28 12:21:55.875588 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 631/1239] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:55 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 34039 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:56.887976 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a77f4de6-8fd3-4905-a5dc-d92e5db564c8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:56.888975 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a77f4de6-8fd3-4905-a5dc-d92e5db564c8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:56.896544 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a77f4de6-8fd3-4905-a5dc-d92e5db564c8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:56.896995 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a77f4de6-8fd3-4905-a5dc-d92e5db564c8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:56.897855 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a77f4de6-8fd3-4905-a5dc-d92e5db564c8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:56.898290 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a77f4de6-8fd3-4905-a5dc-d92e5db564c8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:56.983587 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a77f4de6-8fd3-4905-a5dc-d92e5db564c8 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 35072 microversion: 2.20 time: 0.099541 Oct 28 12:21:56.984256 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 609/1240] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:56 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 35072 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:57.996149 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-16d6916d-ba29-4c8c-b4b3-9483bfe659ed tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:57.997237 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-16d6916d-ba29-4c8c-b4b3-9483bfe659ed tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:58.004334 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-16d6916d-ba29-4c8c-b4b3-9483bfe659ed tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:58.004773 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-16d6916d-ba29-4c8c-b4b3-9483bfe659ed tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:58.005527 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-16d6916d-ba29-4c8c-b4b3-9483bfe659ed tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:58.005950 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-16d6916d-ba29-4c8c-b4b3-9483bfe659ed tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:58.078745 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-16d6916d-ba29-4c8c-b4b3-9483bfe659ed tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 36477 microversion: 2.20 time: 0.086537 Oct 28 12:21:58.079389 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 632/1241] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:57 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 36477 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:21:59.091721 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0cc99974-9daa-4b9b-8803-72b0a7d705f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:21:59.092631 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0cc99974-9daa-4b9b-8803-72b0a7d705f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:21:59.099551 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0cc99974-9daa-4b9b-8803-72b0a7d705f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:59.099997 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0cc99974-9daa-4b9b-8803-72b0a7d705f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:59.100766 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0cc99974-9daa-4b9b-8803-72b0a7d705f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:21:59.101200 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0cc99974-9daa-4b9b-8803-72b0a7d705f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:21:59.175034 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0cc99974-9daa-4b9b-8803-72b0a7d705f1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 37929 microversion: 2.20 time: 0.086829 Oct 28 12:21:59.176016 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 610/1242] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:21:59 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 37929 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:22:00.187904 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-217df9d4-32ad-4995-8de9-77b87517c676 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:22:00.188875 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-217df9d4-32ad-4995-8de9-77b87517c676 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:00.195674 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-217df9d4-32ad-4995-8de9-77b87517c676 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:00.196109 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-217df9d4-32ad-4995-8de9-77b87517c676 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:00.196861 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-217df9d4-32ad-4995-8de9-77b87517c676 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:00.197286 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-217df9d4-32ad-4995-8de9-77b87517c676 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:00.277482 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-217df9d4-32ad-4995-8de9-77b87517c676 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 38249 microversion: 2.20 time: 0.093605 Oct 28 12:22:00.278120 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 633/1243] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:22:00 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 38249 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:22:01.289576 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9b3a7d04-83c4-41f4-aee1-b256faec4081 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:22:01.290555 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9b3a7d04-83c4-41f4-aee1-b256faec4081 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:01.297591 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9b3a7d04-83c4-41f4-aee1-b256faec4081 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:01.298028 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9b3a7d04-83c4-41f4-aee1-b256faec4081 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:01.298812 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9b3a7d04-83c4-41f4-aee1-b256faec4081 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:01.299241 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9b3a7d04-83c4-41f4-aee1-b256faec4081 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:01.364406 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9b3a7d04-83c4-41f4-aee1-b256faec4081 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 38249 microversion: 2.20 time: 0.078752 Oct 28 12:22:01.365014 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 611/1244] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:22:01 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 38249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:22:02.376661 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-86d41434-b097-4c28-bb67-3ffc8f562088 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:22:02.378201 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-86d41434-b097-4c28-bb67-3ffc8f562088 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:02.384955 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-86d41434-b097-4c28-bb67-3ffc8f562088 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:02.385399 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-86d41434-b097-4c28-bb67-3ffc8f562088 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:02.386149 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-86d41434-b097-4c28-bb67-3ffc8f562088 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:02.386663 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-86d41434-b097-4c28-bb67-3ffc8f562088 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:02.447011 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-86d41434-b097-4c28-bb67-3ffc8f562088 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 38249 microversion: 2.20 time: 0.074278 Oct 28 12:22:02.447625 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 634/1245] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:22:02 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 38249 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:22:03.459578 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ba935d18-97eb-4b17-9bbe-21402b580ba0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:22:03.460612 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ba935d18-97eb-4b17-9bbe-21402b580ba0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:03.467403 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba935d18-97eb-4b17-9bbe-21402b580ba0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:03.467850 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba935d18-97eb-4b17-9bbe-21402b580ba0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:03.468617 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba935d18-97eb-4b17-9bbe-21402b580ba0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:03.469055 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ba935d18-97eb-4b17-9bbe-21402b580ba0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:03.540149 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ba935d18-97eb-4b17-9bbe-21402b580ba0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 38249 microversion: 2.20 time: 0.084592 Oct 28 12:22:03.540787 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 612/1246] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:22:03 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 38249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:22:04.553573 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3e67c49b-8ee8-432c-adec-702ab721c8bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:22:04.554576 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3e67c49b-8ee8-432c-adec-702ab721c8bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:04.561291 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3e67c49b-8ee8-432c-adec-702ab721c8bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:04.561725 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3e67c49b-8ee8-432c-adec-702ab721c8bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:04.562475 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3e67c49b-8ee8-432c-adec-702ab721c8bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:04.562927 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3e67c49b-8ee8-432c-adec-702ab721c8bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:04.644986 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3e67c49b-8ee8-432c-adec-702ab721c8bb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 200 len: 38392 microversion: 2.20 time: 0.095966 Oct 28 12:22:04.645615 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 635/1247] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:22:04 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 38392 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:22:04.656102 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2da5a16a-f15f-4fa9-839c-91efde67a799 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:04.656689 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2da5a16a-f15f-4fa9-839c-91efde67a799 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:04.663642 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2da5a16a-f15f-4fa9-839c-91efde67a799 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:04.664127 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2da5a16a-f15f-4fa9-839c-91efde67a799 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:04.664898 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2da5a16a-f15f-4fa9-839c-91efde67a799 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:04.665332 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2da5a16a-f15f-4fa9-839c-91efde67a799 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:04.688510 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2da5a16a-f15f-4fa9-839c-91efde67a799 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/ips" status: 200 len: 150 microversion: 2.20 time: 0.036560 Oct 28 12:22:04.689082 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 613/1248] 10.222.0.37 () {60 vars in 1288 bytes} [Thu Oct 28 12:22:04 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:22:06.957585 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a6c75b7b-e98a-4c30-b63b-04dc640b1b06 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:22:06.958229 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a6c75b7b-e98a-4c30-b63b-04dc640b1b06 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:06.965201 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a6c75b7b-e98a-4c30-b63b-04dc640b1b06 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:06.965652 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a6c75b7b-e98a-4c30-b63b-04dc640b1b06 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:06.966422 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a6c75b7b-e98a-4c30-b63b-04dc640b1b06 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:06.966896 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a6c75b7b-e98a-4c30-b63b-04dc640b1b06 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:06.990710 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-a6c75b7b-e98a-4c30-b63b-04dc640b1b06 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lazy-loading 'flavor' on Instance uuid 19635150-a15f-4d59-a3a3-adc15a411e40 {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:22:07.248161 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a6c75b7b-e98a-4c30-b63b-04dc640b1b06 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 202 len: 0 microversion: 2.20 time: 0.294493 Oct 28 12:22:07.248973 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 636/1249] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:22:06 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:22:07.257003 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-76194e33-f8b9-4f53-b6ae-5090c684aed1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:07.257622 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-76194e33-f8b9-4f53-b6ae-5090c684aed1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:07.263855 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-76194e33-f8b9-4f53-b6ae-5090c684aed1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:07.264303 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-76194e33-f8b9-4f53-b6ae-5090c684aed1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:07.265169 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-76194e33-f8b9-4f53-b6ae-5090c684aed1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:07.265636 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-76194e33-f8b9-4f53-b6ae-5090c684aed1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:07.385826 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-76194e33-f8b9-4f53-b6ae-5090c684aed1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:07.394128 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-76194e33-f8b9-4f53-b6ae-5090c684aed1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:07.395727 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-76194e33-f8b9-4f53-b6ae-5090c684aed1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:07.396894 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-76194e33-f8b9-4f53-b6ae-5090c684aed1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1720 microversion: 2.20 time: 0.143847 Oct 28 12:22:07.397457 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 614/1250] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:07 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1720 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:08.417138 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1ed82bfb-4881-44c4-94cd-6867e76eef7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:08.417826 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1ed82bfb-4881-44c4-94cd-6867e76eef7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:08.424298 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1ed82bfb-4881-44c4-94cd-6867e76eef7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:08.424746 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1ed82bfb-4881-44c4-94cd-6867e76eef7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:08.426150 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1ed82bfb-4881-44c4-94cd-6867e76eef7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:08.426580 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1ed82bfb-4881-44c4-94cd-6867e76eef7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:08.547902 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1ed82bfb-4881-44c4-94cd-6867e76eef7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:08.556059 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1ed82bfb-4881-44c4-94cd-6867e76eef7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:08.557525 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1ed82bfb-4881-44c4-94cd-6867e76eef7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:08.558826 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1ed82bfb-4881-44c4-94cd-6867e76eef7d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1720 microversion: 2.20 time: 0.146231 Oct 28 12:22:08.559416 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 637/1251] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:08 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:09.576826 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5cbe702b-a21f-42a6-aa8a-b0d65c0cf041 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:09.577415 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5cbe702b-a21f-42a6-aa8a-b0d65c0cf041 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:09.583774 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5cbe702b-a21f-42a6-aa8a-b0d65c0cf041 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:09.584226 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5cbe702b-a21f-42a6-aa8a-b0d65c0cf041 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:09.584988 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5cbe702b-a21f-42a6-aa8a-b0d65c0cf041 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:09.585420 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5cbe702b-a21f-42a6-aa8a-b0d65c0cf041 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:09.705535 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5cbe702b-a21f-42a6-aa8a-b0d65c0cf041 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:09.713108 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5cbe702b-a21f-42a6-aa8a-b0d65c0cf041 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:09.714673 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5cbe702b-a21f-42a6-aa8a-b0d65c0cf041 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:09.715839 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5cbe702b-a21f-42a6-aa8a-b0d65c0cf041 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1720 microversion: 2.20 time: 0.142742 Oct 28 12:22:09.716418 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 615/1252] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:09 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1720 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:10.734055 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-77e6045d-dd17-4fad-878c-c5eb20876e82 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:10.734657 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-77e6045d-dd17-4fad-878c-c5eb20876e82 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:10.740914 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77e6045d-dd17-4fad-878c-c5eb20876e82 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:10.741358 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77e6045d-dd17-4fad-878c-c5eb20876e82 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:10.742178 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77e6045d-dd17-4fad-878c-c5eb20876e82 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:10.742614 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77e6045d-dd17-4fad-878c-c5eb20876e82 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:10.861119 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-77e6045d-dd17-4fad-878c-c5eb20876e82 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:10.869292 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-77e6045d-dd17-4fad-878c-c5eb20876e82 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:10.870805 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-77e6045d-dd17-4fad-878c-c5eb20876e82 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:10.873132 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-77e6045d-dd17-4fad-878c-c5eb20876e82 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1720 microversion: 2.20 time: 0.142306 Oct 28 12:22:10.873785 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 638/1253] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:10 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1720 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:11.892228 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d976e1cb-2386-461b-bc86-cf127a904735 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:11.892824 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d976e1cb-2386-461b-bc86-cf127a904735 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:11.899075 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d976e1cb-2386-461b-bc86-cf127a904735 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:11.899517 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d976e1cb-2386-461b-bc86-cf127a904735 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:11.900268 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d976e1cb-2386-461b-bc86-cf127a904735 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:11.900692 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d976e1cb-2386-461b-bc86-cf127a904735 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:12.020134 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d976e1cb-2386-461b-bc86-cf127a904735 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:12.027753 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d976e1cb-2386-461b-bc86-cf127a904735 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:12.029210 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d976e1cb-2386-461b-bc86-cf127a904735 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:12.030353 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d976e1cb-2386-461b-bc86-cf127a904735 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1720 microversion: 2.20 time: 0.141879 Oct 28 12:22:12.030947 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 616/1254] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:11 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1720 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:13.048879 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ae53e7f8-c29e-4c0d-be70-332ee7b45df9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:13.049402 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ae53e7f8-c29e-4c0d-be70-332ee7b45df9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:13.056429 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ae53e7f8-c29e-4c0d-be70-332ee7b45df9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:13.056869 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ae53e7f8-c29e-4c0d-be70-332ee7b45df9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:13.057623 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ae53e7f8-c29e-4c0d-be70-332ee7b45df9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:13.058055 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ae53e7f8-c29e-4c0d-be70-332ee7b45df9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:13.179441 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ae53e7f8-c29e-4c0d-be70-332ee7b45df9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:13.187000 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ae53e7f8-c29e-4c0d-be70-332ee7b45df9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:13.188477 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ae53e7f8-c29e-4c0d-be70-332ee7b45df9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:13.189619 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ae53e7f8-c29e-4c0d-be70-332ee7b45df9 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1720 microversion: 2.20 time: 0.144547 Oct 28 12:22:13.190201 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 639/1255] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:13 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1720 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:14.208838 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e1083837-cd9f-4000-8855-2f9d5356a81c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:14.209448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e1083837-cd9f-4000-8855-2f9d5356a81c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:14.215856 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e1083837-cd9f-4000-8855-2f9d5356a81c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:14.216301 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e1083837-cd9f-4000-8855-2f9d5356a81c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:14.217069 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e1083837-cd9f-4000-8855-2f9d5356a81c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:14.217500 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e1083837-cd9f-4000-8855-2f9d5356a81c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:14.336240 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e1083837-cd9f-4000-8855-2f9d5356a81c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:14.344240 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e1083837-cd9f-4000-8855-2f9d5356a81c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:14.345759 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e1083837-cd9f-4000-8855-2f9d5356a81c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:14.347008 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e1083837-cd9f-4000-8855-2f9d5356a81c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1720 microversion: 2.20 time: 0.142398 Oct 28 12:22:14.347563 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 617/1256] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:14 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1720 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:15.364542 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a68eddfd-c180-4f00-a3f6-dfe69280dc4f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:15.365150 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a68eddfd-c180-4f00-a3f6-dfe69280dc4f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:15.371423 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a68eddfd-c180-4f00-a3f6-dfe69280dc4f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:15.371861 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a68eddfd-c180-4f00-a3f6-dfe69280dc4f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:15.372620 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a68eddfd-c180-4f00-a3f6-dfe69280dc4f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:15.373050 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a68eddfd-c180-4f00-a3f6-dfe69280dc4f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:15.493597 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a68eddfd-c180-4f00-a3f6-dfe69280dc4f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:15.501237 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a68eddfd-c180-4f00-a3f6-dfe69280dc4f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:15.502741 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a68eddfd-c180-4f00-a3f6-dfe69280dc4f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:15.503887 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a68eddfd-c180-4f00-a3f6-dfe69280dc4f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1720 microversion: 2.20 time: 0.143046 Oct 28 12:22:15.504449 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 640/1257] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:15 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1720 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:16.522611 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a0de248a-1231-4aaf-b254-159aa82a3de3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:16.523238 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a0de248a-1231-4aaf-b254-159aa82a3de3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:16.529420 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a0de248a-1231-4aaf-b254-159aa82a3de3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:16.530010 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a0de248a-1231-4aaf-b254-159aa82a3de3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:16.530800 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a0de248a-1231-4aaf-b254-159aa82a3de3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:16.531229 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a0de248a-1231-4aaf-b254-159aa82a3de3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:16.654217 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a0de248a-1231-4aaf-b254-159aa82a3de3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:16.661974 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a0de248a-1231-4aaf-b254-159aa82a3de3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:16.663483 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a0de248a-1231-4aaf-b254-159aa82a3de3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:16.664623 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a0de248a-1231-4aaf-b254-159aa82a3de3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1720 microversion: 2.20 time: 0.146370 Oct 28 12:22:16.665167 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 618/1258] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:16 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:17.682952 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-14ba410e-fb7f-468f-b66d-cfa217791738 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:17.683619 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-14ba410e-fb7f-468f-b66d-cfa217791738 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:17.689844 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-14ba410e-fb7f-468f-b66d-cfa217791738 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:17.690291 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-14ba410e-fb7f-468f-b66d-cfa217791738 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:17.691648 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-14ba410e-fb7f-468f-b66d-cfa217791738 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:17.692080 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-14ba410e-fb7f-468f-b66d-cfa217791738 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:17.813784 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-14ba410e-fb7f-468f-b66d-cfa217791738 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:17.822166 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-14ba410e-fb7f-468f-b66d-cfa217791738 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:17.823705 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-14ba410e-fb7f-468f-b66d-cfa217791738 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:17.824861 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-14ba410e-fb7f-468f-b66d-cfa217791738 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1720 microversion: 2.20 time: 0.145668 Oct 28 12:22:17.825421 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 641/1259] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:17 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1720 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:18.842820 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ca03c0ce-ca5b-468f-9e41-834aabaf1c99 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:18.843439 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ca03c0ce-ca5b-468f-9e41-834aabaf1c99 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:18.849771 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca03c0ce-ca5b-468f-9e41-834aabaf1c99 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:18.850217 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca03c0ce-ca5b-468f-9e41-834aabaf1c99 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:18.851016 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca03c0ce-ca5b-468f-9e41-834aabaf1c99 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:18.851456 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca03c0ce-ca5b-468f-9e41-834aabaf1c99 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:18.970101 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ca03c0ce-ca5b-468f-9e41-834aabaf1c99 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:18.978328 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ca03c0ce-ca5b-468f-9e41-834aabaf1c99 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:18.979867 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ca03c0ce-ca5b-468f-9e41-834aabaf1c99 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:18.981018 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ca03c0ce-ca5b-468f-9e41-834aabaf1c99 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1741 microversion: 2.20 time: 0.142050 Oct 28 12:22:18.981572 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 619/1260] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:18 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1741 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:19.998759 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-85ac6023-ad3c-4f1e-965c-343e5c11d5c6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:19.999368 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-85ac6023-ad3c-4f1e-965c-343e5c11d5c6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:20.006212 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-85ac6023-ad3c-4f1e-965c-343e5c11d5c6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:20.006667 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-85ac6023-ad3c-4f1e-965c-343e5c11d5c6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:20.007455 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-85ac6023-ad3c-4f1e-965c-343e5c11d5c6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:20.007889 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-85ac6023-ad3c-4f1e-965c-343e5c11d5c6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:20.130375 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-85ac6023-ad3c-4f1e-965c-343e5c11d5c6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:20.137998 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-85ac6023-ad3c-4f1e-965c-343e5c11d5c6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:20.139503 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-85ac6023-ad3c-4f1e-965c-343e5c11d5c6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:20.140652 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-85ac6023-ad3c-4f1e-965c-343e5c11d5c6 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1741 microversion: 2.20 time: 0.145662 Oct 28 12:22:20.141215 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 642/1261] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:19 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1741 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:21.158476 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-32db3fd3-3b15-4ce4-8659-2a99cfff228c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:21.159099 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-32db3fd3-3b15-4ce4-8659-2a99cfff228c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:21.165278 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-32db3fd3-3b15-4ce4-8659-2a99cfff228c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:21.165716 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-32db3fd3-3b15-4ce4-8659-2a99cfff228c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:21.166470 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-32db3fd3-3b15-4ce4-8659-2a99cfff228c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:21.166928 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-32db3fd3-3b15-4ce4-8659-2a99cfff228c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:21.285498 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-32db3fd3-3b15-4ce4-8659-2a99cfff228c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:21.293355 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-32db3fd3-3b15-4ce4-8659-2a99cfff228c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:21.294897 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-32db3fd3-3b15-4ce4-8659-2a99cfff228c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:21.296044 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-32db3fd3-3b15-4ce4-8659-2a99cfff228c tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1741 microversion: 2.20 time: 0.141237 Oct 28 12:22:21.296610 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 620/1262] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:21 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1741 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:22.314585 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-072dad2e-eb41-422a-bb38-dc0b0beb3c63 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:22.315976 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-072dad2e-eb41-422a-bb38-dc0b0beb3c63 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:22.324516 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-072dad2e-eb41-422a-bb38-dc0b0beb3c63 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:22.324968 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-072dad2e-eb41-422a-bb38-dc0b0beb3c63 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:22.325759 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-072dad2e-eb41-422a-bb38-dc0b0beb3c63 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:22.326200 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-072dad2e-eb41-422a-bb38-dc0b0beb3c63 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:22.453224 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-072dad2e-eb41-422a-bb38-dc0b0beb3c63 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:22.461321 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-072dad2e-eb41-422a-bb38-dc0b0beb3c63 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:22.462829 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-072dad2e-eb41-422a-bb38-dc0b0beb3c63 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:22.464074 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-072dad2e-eb41-422a-bb38-dc0b0beb3c63 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1741 microversion: 2.20 time: 0.153224 Oct 28 12:22:22.464627 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 643/1263] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:22 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1741 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:23.482172 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ea788f8e-bc7a-405c-841f-85537ce91956 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:23.482803 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ea788f8e-bc7a-405c-841f-85537ce91956 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:23.489535 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ea788f8e-bc7a-405c-841f-85537ce91956 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:23.489981 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ea788f8e-bc7a-405c-841f-85537ce91956 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:23.490776 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ea788f8e-bc7a-405c-841f-85537ce91956 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:23.491211 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ea788f8e-bc7a-405c-841f-85537ce91956 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:23.616652 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ea788f8e-bc7a-405c-841f-85537ce91956 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:23.623931 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ea788f8e-bc7a-405c-841f-85537ce91956 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:23.625419 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ea788f8e-bc7a-405c-841f-85537ce91956 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:23.626607 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ea788f8e-bc7a-405c-841f-85537ce91956 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1736 microversion: 2.20 time: 0.148115 Oct 28 12:22:23.627359 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 621/1264] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:23 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:24.066779 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-1b68288a-f750-46bf-bebe-2facc78a59fb req-d4ae55ac-ca54-41c3-a7a5-907170200615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19635150-a15f-4d59-a3a3-adc15a411e40", "name": "network-vif-plugged", "status": "completed", "tag": "df78786b-91a7-4ab8-9ff2-b69bbf31776f"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:22:24.069986 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:22:24.069986 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:22:24.081343 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-1b68288a-f750-46bf-bebe-2facc78a59fb req-d4ae55ac-ca54-41c3-a7a5-907170200615 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:24.083024 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-1b68288a-f750-46bf-bebe-2facc78a59fb req-d4ae55ac-ca54-41c3-a7a5-907170200615 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:24.100735 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-1b68288a-f750-46bf-bebe-2facc78a59fb req-d4ae55ac-ca54-41c3-a7a5-907170200615 service nova] Creating event network-vif-plugged:df78786b-91a7-4ab8-9ff2-b69bbf31776f for instance 19635150-a15f-4d59-a3a3-adc15a411e40 on hv-cinder-81571 Oct 28 12:22:24.109586 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-1b68288a-f750-46bf-bebe-2facc78a59fb req-d4ae55ac-ca54-41c3-a7a5-907170200615 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048097 Oct 28 12:22:24.110926 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 644/1265] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:22:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:22:24.655266 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a6540f83-ebcd-4bda-ab95-0373fe5bff13 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:24.657093 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a6540f83-ebcd-4bda-ab95-0373fe5bff13 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:24.673060 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6540f83-ebcd-4bda-ab95-0373fe5bff13 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:24.673539 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6540f83-ebcd-4bda-ab95-0373fe5bff13 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:24.674449 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6540f83-ebcd-4bda-ab95-0373fe5bff13 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:24.675030 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a6540f83-ebcd-4bda-ab95-0373fe5bff13 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:24.811683 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a6540f83-ebcd-4bda-ab95-0373fe5bff13 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:24.823756 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a6540f83-ebcd-4bda-ab95-0373fe5bff13 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:24.825247 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a6540f83-ebcd-4bda-ab95-0373fe5bff13 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:24.826422 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a6540f83-ebcd-4bda-ab95-0373fe5bff13 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1736 microversion: 2.20 time: 0.177702 Oct 28 12:22:24.827014 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 622/1266] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:24 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:25.846942 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6e8b054b-052d-401f-a805-cb66ac50954f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:25.848358 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6e8b054b-052d-401f-a805-cb66ac50954f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:25.857827 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6e8b054b-052d-401f-a805-cb66ac50954f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:25.858276 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6e8b054b-052d-401f-a805-cb66ac50954f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:25.859116 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6e8b054b-052d-401f-a805-cb66ac50954f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:25.859540 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6e8b054b-052d-401f-a805-cb66ac50954f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:25.999982 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6e8b054b-052d-401f-a805-cb66ac50954f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:26.009511 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6e8b054b-052d-401f-a805-cb66ac50954f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:26.011186 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6e8b054b-052d-401f-a805-cb66ac50954f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:26.012482 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6e8b054b-052d-401f-a805-cb66ac50954f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1736 microversion: 2.20 time: 0.170870 Oct 28 12:22:26.013312 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 645/1267] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:25 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:27.032645 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-38dcc332-aca5-44ec-8b70-541cbf752ecc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:27.035011 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-38dcc332-aca5-44ec-8b70-541cbf752ecc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:27.044178 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-38dcc332-aca5-44ec-8b70-541cbf752ecc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:27.045465 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-38dcc332-aca5-44ec-8b70-541cbf752ecc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:27.046320 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-38dcc332-aca5-44ec-8b70-541cbf752ecc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:27.046863 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-38dcc332-aca5-44ec-8b70-541cbf752ecc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:27.211580 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-38dcc332-aca5-44ec-8b70-541cbf752ecc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:27.221708 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-38dcc332-aca5-44ec-8b70-541cbf752ecc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:27.223584 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-38dcc332-aca5-44ec-8b70-541cbf752ecc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:27.225678 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-38dcc332-aca5-44ec-8b70-541cbf752ecc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1736 microversion: 2.20 time: 0.198629 Oct 28 12:22:27.226930 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 623/1268] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:27 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:28.244267 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-02cecd7b-986e-49d6-b3db-19ec67901775 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:28.244894 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-02cecd7b-986e-49d6-b3db-19ec67901775 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:28.252518 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-02cecd7b-986e-49d6-b3db-19ec67901775 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:28.253434 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-02cecd7b-986e-49d6-b3db-19ec67901775 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:28.254208 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-02cecd7b-986e-49d6-b3db-19ec67901775 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:28.254643 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-02cecd7b-986e-49d6-b3db-19ec67901775 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:28.398056 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-02cecd7b-986e-49d6-b3db-19ec67901775 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:28.406897 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-02cecd7b-986e-49d6-b3db-19ec67901775 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:28.408390 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-02cecd7b-986e-49d6-b3db-19ec67901775 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:28.410130 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-02cecd7b-986e-49d6-b3db-19ec67901775 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1736 microversion: 2.20 time: 0.169700 Oct 28 12:22:28.411015 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 646/1269] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:28 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:29.431988 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c7f2d92c-0be3-4820-acda-4fe38ab61011 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:29.432742 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c7f2d92c-0be3-4820-acda-4fe38ab61011 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:29.440601 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7f2d92c-0be3-4820-acda-4fe38ab61011 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:29.441070 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7f2d92c-0be3-4820-acda-4fe38ab61011 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:29.441832 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7f2d92c-0be3-4820-acda-4fe38ab61011 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:29.442256 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c7f2d92c-0be3-4820-acda-4fe38ab61011 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:29.641319 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c7f2d92c-0be3-4820-acda-4fe38ab61011 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:29.650694 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c7f2d92c-0be3-4820-acda-4fe38ab61011 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:29.652300 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c7f2d92c-0be3-4820-acda-4fe38ab61011 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:29.654999 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c7f2d92c-0be3-4820-acda-4fe38ab61011 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1736 microversion: 2.20 time: 0.229803 Oct 28 12:22:29.659231 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 624/1270] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:29 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:30.676960 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-77b0e21c-65b5-4da5-8d43-ee3d2c75e2cc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:30.677573 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-77b0e21c-65b5-4da5-8d43-ee3d2c75e2cc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:30.684588 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77b0e21c-65b5-4da5-8d43-ee3d2c75e2cc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:30.685029 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77b0e21c-65b5-4da5-8d43-ee3d2c75e2cc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:30.686413 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77b0e21c-65b5-4da5-8d43-ee3d2c75e2cc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:30.686887 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-77b0e21c-65b5-4da5-8d43-ee3d2c75e2cc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:30.828972 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-77b0e21c-65b5-4da5-8d43-ee3d2c75e2cc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:30.838099 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-77b0e21c-65b5-4da5-8d43-ee3d2c75e2cc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:30.839620 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-77b0e21c-65b5-4da5-8d43-ee3d2c75e2cc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:30.840783 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-77b0e21c-65b5-4da5-8d43-ee3d2c75e2cc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1736 microversion: 2.20 time: 0.168233 Oct 28 12:22:30.841364 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 647/1271] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:30 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:31.859429 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3b88127e-0268-4085-a7d1-11c739a05cb5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:31.860637 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3b88127e-0268-4085-a7d1-11c739a05cb5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:31.867921 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3b88127e-0268-4085-a7d1-11c739a05cb5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:31.868587 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3b88127e-0268-4085-a7d1-11c739a05cb5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:31.869745 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3b88127e-0268-4085-a7d1-11c739a05cb5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:31.870176 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3b88127e-0268-4085-a7d1-11c739a05cb5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:32.100862 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3b88127e-0268-4085-a7d1-11c739a05cb5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:32.108843 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3b88127e-0268-4085-a7d1-11c739a05cb5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:32.110364 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3b88127e-0268-4085-a7d1-11c739a05cb5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:32.112199 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3b88127e-0268-4085-a7d1-11c739a05cb5 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1736 microversion: 2.20 time: 0.255936 Oct 28 12:22:32.112955 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 625/1272] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:31 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1736 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:33.098306 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4447cd40-4c82-4778-b8fe-1f1b8969fb0d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:33.099060 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4447cd40-4c82-4778-b8fe-1f1b8969fb0d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:33.100999 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-28f53bd6-db9f-4be5-9e71-db2cdf3904c5 req-f2dbc576-6113-49aa-a838-298dce69b524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aa26e71-aa24-4d33-9b9f-96d11867d037", "tag": "6d493e72-8230-488e-974e-b32ede2a9db0"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:22:33.102781 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:22:33.102781 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:22:33.106021 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4447cd40-4c82-4778-b8fe-1f1b8969fb0d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:33.106711 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4447cd40-4c82-4778-b8fe-1f1b8969fb0d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:33.107680 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4447cd40-4c82-4778-b8fe-1f1b8969fb0d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:33.108123 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4447cd40-4c82-4778-b8fe-1f1b8969fb0d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:33.109855 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-28f53bd6-db9f-4be5-9e71-db2cdf3904c5 req-f2dbc576-6113-49aa-a838-298dce69b524 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:33.110292 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-28f53bd6-db9f-4be5-9e71-db2cdf3904c5 req-f2dbc576-6113-49aa-a838-298dce69b524 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:33.121845 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-28f53bd6-db9f-4be5-9e71-db2cdf3904c5 req-f2dbc576-6113-49aa-a838-298dce69b524 service nova] Creating event network-changed:6d493e72-8230-488e-974e-b32ede2a9db0 for instance 8aa26e71-aa24-4d33-9b9f-96d11867d037 on hv-cinder-81571 Oct 28 12:22:33.128543 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-28f53bd6-db9f-4be5-9e71-db2cdf3904c5 req-f2dbc576-6113-49aa-a838-298dce69b524 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031092 Oct 28 12:22:33.129581 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 626/1273] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:22:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:22:33.136073 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-dc6de7fa-78bb-4397-a5cd-c7337341aca0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:33.137129 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-dc6de7fa-78bb-4397-a5cd-c7337341aca0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:33.141299 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4447cd40-4c82-4778-b8fe-1f1b8969fb0d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:22:33.146433 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dc6de7fa-78bb-4397-a5cd-c7337341aca0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:33.147920 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dc6de7fa-78bb-4397-a5cd-c7337341aca0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:33.149145 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dc6de7fa-78bb-4397-a5cd-c7337341aca0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:33.150116 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dc6de7fa-78bb-4397-a5cd-c7337341aca0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:33.241760 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4447cd40-4c82-4778-b8fe-1f1b8969fb0d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "DELETE /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 204 len: 0 microversion: 2.1 time: 0.146830 Oct 28 12:22:33.245580 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 648/1274] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:22:33 2021] DELETE /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:22:33.252816 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-59df9f31-2750-4609-b94e-f91f8a4564d2 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:33.253681 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-59df9f31-2750-4609-b94e-f91f8a4564d2 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:33.259926 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59df9f31-2750-4609-b94e-f91f8a4564d2 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:33.260657 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59df9f31-2750-4609-b94e-f91f8a4564d2 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:33.261469 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59df9f31-2750-4609-b94e-f91f8a4564d2 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:33.262308 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-59df9f31-2750-4609-b94e-f91f8a4564d2 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:33.362091 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-dc6de7fa-78bb-4397-a5cd-c7337341aca0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:33.373932 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-dc6de7fa-78bb-4397-a5cd-c7337341aca0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:33.378093 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-dc6de7fa-78bb-4397-a5cd-c7337341aca0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:33.379505 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-dc6de7fa-78bb-4397-a5cd-c7337341aca0 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1736 microversion: 2.20 time: 0.248654 Oct 28 12:22:33.380322 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 627/1275] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:33 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1736 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:33.462451 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-59df9f31-2750-4609-b94e-f91f8a4564d2 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:33.470924 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-59df9f31-2750-4609-b94e-f91f8a4564d2 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1567 microversion: 2.1 time: 0.223037 Oct 28 12:22:33.471504 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 649/1276] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:22:33 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:22:34.398175 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-9dc50e44-4058-40be-a20e-1769199108d1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:34.398805 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-9dc50e44-4058-40be-a20e-1769199108d1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:34.405098 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9dc50e44-4058-40be-a20e-1769199108d1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:34.405536 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9dc50e44-4058-40be-a20e-1769199108d1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:34.406286 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9dc50e44-4058-40be-a20e-1769199108d1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:34.406735 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-9dc50e44-4058-40be-a20e-1769199108d1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:34.487509 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1a066a26-514a-4cd0-aaa3-222ad659b4d5 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:34.488141 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1a066a26-514a-4cd0-aaa3-222ad659b4d5 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:34.494582 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1a066a26-514a-4cd0-aaa3-222ad659b4d5 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:34.495064 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1a066a26-514a-4cd0-aaa3-222ad659b4d5 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:34.495832 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1a066a26-514a-4cd0-aaa3-222ad659b4d5 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:34.496267 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1a066a26-514a-4cd0-aaa3-222ad659b4d5 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:34.526882 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9dc50e44-4058-40be-a20e-1769199108d1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:34.534941 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9dc50e44-4058-40be-a20e-1769199108d1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:34.536462 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-9dc50e44-4058-40be-a20e-1769199108d1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:34.537663 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-9dc50e44-4058-40be-a20e-1769199108d1 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1718 microversion: 2.20 time: 0.143176 Oct 28 12:22:34.538225 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 628/1277] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:34 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1718 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:34.619336 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1a066a26-514a-4cd0-aaa3-222ad659b4d5 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:34.626602 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1a066a26-514a-4cd0-aaa3-222ad659b4d5 tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1449 microversion: 2.1 time: 0.142859 Oct 28 12:22:34.627692 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 650/1278] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:22:34 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1449 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:22:35.556176 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f686587e-1b60-4e74-bb92-e7f0a0796ecb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:35.556778 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f686587e-1b60-4e74-bb92-e7f0a0796ecb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:35.563719 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f686587e-1b60-4e74-bb92-e7f0a0796ecb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:35.564396 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f686587e-1b60-4e74-bb92-e7f0a0796ecb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:35.565744 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f686587e-1b60-4e74-bb92-e7f0a0796ecb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:35.566176 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f686587e-1b60-4e74-bb92-e7f0a0796ecb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:35.644283 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b9e3fc0f-0a85-4bb5-9c81-b728e4363b8d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:35.651375 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b9e3fc0f-0a85-4bb5-9c81-b728e4363b8d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:35.660263 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b9e3fc0f-0a85-4bb5-9c81-b728e4363b8d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:35.660715 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b9e3fc0f-0a85-4bb5-9c81-b728e4363b8d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:35.661498 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b9e3fc0f-0a85-4bb5-9c81-b728e4363b8d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:35.661928 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b9e3fc0f-0a85-4bb5-9c81-b728e4363b8d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:35.701939 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f686587e-1b60-4e74-bb92-e7f0a0796ecb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:35.711624 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f686587e-1b60-4e74-bb92-e7f0a0796ecb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:35.713336 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f686587e-1b60-4e74-bb92-e7f0a0796ecb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:35.714629 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f686587e-1b60-4e74-bb92-e7f0a0796ecb tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1718 microversion: 2.20 time: 0.162244 Oct 28 12:22:35.718660 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 629/1279] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:35 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1718 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:35.722573 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-bb8d836d-5c02-4ae6-baf4-da81cc708c63 req-9712bb00-575e-4934-969c-99c51b956540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aa26e71-aa24-4d33-9b9f-96d11867d037", "name": "network-vif-deleted", "tag": "6d493e72-8230-488e-974e-b32ede2a9db0"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:22:35.724093 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:22:35.724093 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:22:35.733649 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-bb8d836d-5c02-4ae6-baf4-da81cc708c63 req-9712bb00-575e-4934-969c-99c51b956540 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:35.734422 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-bb8d836d-5c02-4ae6-baf4-da81cc708c63 req-9712bb00-575e-4934-969c-99c51b956540 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:35.745832 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b9e3fc0f-0a85-4bb5-9c81-b728e4363b8d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6695129614aa49dc9fcc1e1b27083b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a714ee6cfd984bbf823ab5c422c5a3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:35.747926 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-bb8d836d-5c02-4ae6-baf4-da81cc708c63 req-9712bb00-575e-4934-969c-99c51b956540 service nova] Creating event network-vif-deleted:6d493e72-8230-488e-974e-b32ede2a9db0 for instance 8aa26e71-aa24-4d33-9b9f-96d11867d037 on hv-cinder-81571 Oct 28 12:22:35.753981 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b9e3fc0f-0a85-4bb5-9c81-b728e4363b8d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 200 len: 1381 microversion: 2.1 time: 0.113454 Oct 28 12:22:35.754563 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 651/1280] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:22:35 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 1381 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:22:35.754987 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-bb8d836d-5c02-4ae6-baf4-da81cc708c63 req-9712bb00-575e-4934-969c-99c51b956540 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037924 Oct 28 12:22:35.755659 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 630/1281] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:22:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:22:36.732554 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ba327368-2644-4a34-8c7c-892dc46ae136 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:36.733163 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ba327368-2644-4a34-8c7c-892dc46ae136 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:36.739422 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ba327368-2644-4a34-8c7c-892dc46ae136 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:36.739868 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ba327368-2644-4a34-8c7c-892dc46ae136 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:36.740630 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ba327368-2644-4a34-8c7c-892dc46ae136 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:36.741067 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ba327368-2644-4a34-8c7c-892dc46ae136 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:36.772122 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5e65cb21-887f-4bcc-9d2a-27aef9739bff tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:36.772892 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5e65cb21-887f-4bcc-9d2a-27aef9739bff tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] [instance: 8aa26e71-aa24-4d33-9b9f-96d11867d037] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:36.779756 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e65cb21-887f-4bcc-9d2a-27aef9739bff tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:36.780206 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e65cb21-887f-4bcc-9d2a-27aef9739bff tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:36.780984 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e65cb21-887f-4bcc-9d2a-27aef9739bff tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:36.781417 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5e65cb21-887f-4bcc-9d2a-27aef9739bff tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:36.794839 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-5e65cb21-887f-4bcc-9d2a-27aef9739bff tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] HTTP exception thrown: Instance 8aa26e71-aa24-4d33-9b9f-96d11867d037 could not be found. Oct 28 12:22:36.795436 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5e65cb21-887f-4bcc-9d2a-27aef9739bff tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Returning 404 to user: Instance 8aa26e71-aa24-4d33-9b9f-96d11867d037 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:22:36.796260 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5e65cb21-887f-4bcc-9d2a-27aef9739bff tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037" status: 404 len: 111 microversion: 2.1 time: 0.028896 Oct 28 12:22:36.796804 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 631/1282] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:22:36 2021] GET /compute/v2.1/servers/8aa26e71-aa24-4d33-9b9f-96d11867d037 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:22:36.916061 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ba327368-2644-4a34-8c7c-892dc46ae136 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:36.924180 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ba327368-2644-4a34-8c7c-892dc46ae136 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:36.925688 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ba327368-2644-4a34-8c7c-892dc46ae136 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:36.927136 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ba327368-2644-4a34-8c7c-892dc46ae136 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1661 microversion: 2.20 time: 0.198107 Oct 28 12:22:36.927640 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 652/1283] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:36 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1661 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:36.944967 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f442907c-b10b-47d7-af2e-fdacbd8bd2a2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7952a64c-f7ea-4c2f-b8bd-1987ad81fa93"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:22:36.946047 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f442907c-b10b-47d7-af2e-fdacbd8bd2a2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:36.951883 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f442907c-b10b-47d7-af2e-fdacbd8bd2a2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:36.952331 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f442907c-b10b-47d7-af2e-fdacbd8bd2a2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:36.953139 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f442907c-b10b-47d7-af2e-fdacbd8bd2a2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:36.953586 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f442907c-b10b-47d7-af2e-fdacbd8bd2a2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:37.000918 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-02a8bd04-5d5a-4ad9-ba50-7dedc1be9b7d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] Calling method '.version_select at 0x7f11f36c4700>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:37.020535 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-02a8bd04-5d5a-4ad9-ba50-7dedc1be9b7d tempest-TestShelveInstance-1405702522 tempest-TestShelveInstance-1405702522-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-669426014" status: 202 len: 0 microversion: 2.1 time: 0.023221 Oct 28 12:22:37.021636 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 653/1284] 10.222.0.37 () {58 vars in 1250 bytes} [Thu Oct 28 12:22:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-669426014 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:22:37.223853 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f442907c-b10b-47d7-af2e-fdacbd8bd2a2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.282688 Oct 28 12:22:37.224465 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 632/1285] 10.222.0.37 () {62 vars in 1363 bytes} [Thu Oct 28 12:22:36 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/os-volume_attachments => generated 188 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:22:37.333153 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-52418dcc-70e3-44a5-8db3-8c3e0a77c935 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:37.333725 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-52418dcc-70e3-44a5-8db3-8c3e0a77c935 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:37.339813 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-52418dcc-70e3-44a5-8db3-8c3e0a77c935 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:37.340266 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-52418dcc-70e3-44a5-8db3-8c3e0a77c935 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:37.341036 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-52418dcc-70e3-44a5-8db3-8c3e0a77c935 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:37.341468 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-52418dcc-70e3-44a5-8db3-8c3e0a77c935 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:37.587392 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-52418dcc-70e3-44a5-8db3-8c3e0a77c935 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "DELETE /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/os-volume_attachments/7952a64c-f7ea-4c2f-b8bd-1987ad81fa93" status: 202 len: 0 microversion: 2.20 time: 0.258377 Oct 28 12:22:37.587997 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 654/1286] 10.222.0.37 () {60 vars in 1456 bytes} [Thu Oct 28 12:22:37 2021] DELETE /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/os-volume_attachments/7952a64c-f7ea-4c2f-b8bd-1987ad81fa93 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:22:37.641659 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-db0ba207-4baf-4477-8d72-596daaf4635f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:22:37.642225 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-db0ba207-4baf-4477-8d72-596daaf4635f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:37.648026 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db0ba207-4baf-4477-8d72-596daaf4635f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:37.648476 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db0ba207-4baf-4477-8d72-596daaf4635f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:37.649258 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db0ba207-4baf-4477-8d72-596daaf4635f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:37.649691 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-db0ba207-4baf-4477-8d72-596daaf4635f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:37.726004 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-db0ba207-4baf-4477-8d72-596daaf4635f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action" status: 202 len: 0 microversion: 2.20 time: 0.087976 Oct 28 12:22:37.726795 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 633/1287] 10.222.0.37 () {62 vars in 1318 bytes} [Thu Oct 28 12:22:37 2021] POST /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:22:37.734715 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ebdf967b-b333-414f-a75a-0ec5ff8731af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:37.735576 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ebdf967b-b333-414f-a75a-0ec5ff8731af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:37.743123 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ebdf967b-b333-414f-a75a-0ec5ff8731af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:37.743722 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ebdf967b-b333-414f-a75a-0ec5ff8731af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:37.744650 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ebdf967b-b333-414f-a75a-0ec5ff8731af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:37.745129 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ebdf967b-b333-414f-a75a-0ec5ff8731af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:37.936303 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ebdf967b-b333-414f-a75a-0ec5ff8731af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:37.944493 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ebdf967b-b333-414f-a75a-0ec5ff8731af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:37.946233 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ebdf967b-b333-414f-a75a-0ec5ff8731af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:37.948243 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ebdf967b-b333-414f-a75a-0ec5ff8731af tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1669 microversion: 2.20 time: 0.217246 Oct 28 12:22:37.951489 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 655/1288] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:37 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1669 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:22:38.030223 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-d70887a9-9a44-4cba-9229-e4b6ef159e9c req-d2520566-8dac-40a8-ac96-b9c7b2ce3f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19635150-a15f-4d59-a3a3-adc15a411e40", "name": "network-vif-unplugged", "status": "completed", "tag": "df78786b-91a7-4ab8-9ff2-b69bbf31776f"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:22:38.031948 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:22:38.031948 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:22:38.042364 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-d70887a9-9a44-4cba-9229-e4b6ef159e9c req-d2520566-8dac-40a8-ac96-b9c7b2ce3f4b service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:38.043786 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-d70887a9-9a44-4cba-9229-e4b6ef159e9c req-d2520566-8dac-40a8-ac96-b9c7b2ce3f4b service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:38.057990 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.compute.server_external_events [req-d70887a9-9a44-4cba-9229-e4b6ef159e9c req-d2520566-8dac-40a8-ac96-b9c7b2ce3f4b service nova] Unable to find a host for instance 19635150-a15f-4d59-a3a3-adc15a411e40. Dropping event network-vif-unplugged {{(pid=115797) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 28 12:22:38.058915 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-d70887a9-9a44-4cba-9229-e4b6ef159e9c req-d2520566-8dac-40a8-ac96-b9c7b2ce3f4b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033815 Oct 28 12:22:38.059916 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 634/1289] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:22:38 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 12:22:39.094396 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9eed554c-2c02-491d-ae1d-a85d31ce08aa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:39.095467 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9eed554c-2c02-491d-ae1d-a85d31ce08aa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:39.102837 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9eed554c-2c02-491d-ae1d-a85d31ce08aa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:39.103678 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9eed554c-2c02-491d-ae1d-a85d31ce08aa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:39.105036 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9eed554c-2c02-491d-ae1d-a85d31ce08aa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:39.105774 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9eed554c-2c02-491d-ae1d-a85d31ce08aa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:39.197416 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:22:39.198489 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: Thu Oct 28 12:22:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:22:39.465417 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9eed554c-2c02-491d-ae1d-a85d31ce08aa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:39.474975 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9eed554c-2c02-491d-ae1d-a85d31ce08aa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:39.479937 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9eed554c-2c02-491d-ae1d-a85d31ce08aa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:39.481543 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9eed554c-2c02-491d-ae1d-a85d31ce08aa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.515897 Oct 28 12:22:39.494158 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 656/1290] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:38 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:40.500032 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-685ffefc-45eb-4596-a070-510f572ddec2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:40.501471 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-685ffefc-45eb-4596-a070-510f572ddec2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:40.508748 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-685ffefc-45eb-4596-a070-510f572ddec2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:40.510053 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-685ffefc-45eb-4596-a070-510f572ddec2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:40.511227 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-685ffefc-45eb-4596-a070-510f572ddec2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:40.511984 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-685ffefc-45eb-4596-a070-510f572ddec2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:40.920507 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-685ffefc-45eb-4596-a070-510f572ddec2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:40.942859 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-685ffefc-45eb-4596-a070-510f572ddec2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:40.943488 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-685ffefc-45eb-4596-a070-510f572ddec2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:40.944732 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-685ffefc-45eb-4596-a070-510f572ddec2 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.448520 Oct 28 12:22:40.945689 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 635/1291] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:40 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:41.963861 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-44ab5659-26d5-470f-aaf1-2685d44ded3d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:41.964474 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-44ab5659-26d5-470f-aaf1-2685d44ded3d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:41.970807 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44ab5659-26d5-470f-aaf1-2685d44ded3d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:41.971255 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44ab5659-26d5-470f-aaf1-2685d44ded3d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:41.972025 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44ab5659-26d5-470f-aaf1-2685d44ded3d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:41.972455 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44ab5659-26d5-470f-aaf1-2685d44ded3d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:42.232230 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-44ab5659-26d5-470f-aaf1-2685d44ded3d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:42.241054 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-44ab5659-26d5-470f-aaf1-2685d44ded3d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:42.242720 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-44ab5659-26d5-470f-aaf1-2685d44ded3d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:42.244304 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-44ab5659-26d5-470f-aaf1-2685d44ded3d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.284154 Oct 28 12:22:42.245051 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 657/1292] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:41 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:43.264802 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c18b53f3-361d-4502-b2e3-5721c9fbbe6e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:43.266342 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c18b53f3-361d-4502-b2e3-5721c9fbbe6e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:43.296832 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c18b53f3-361d-4502-b2e3-5721c9fbbe6e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:43.297277 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c18b53f3-361d-4502-b2e3-5721c9fbbe6e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:43.298073 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c18b53f3-361d-4502-b2e3-5721c9fbbe6e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:43.299054 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c18b53f3-361d-4502-b2e3-5721c9fbbe6e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:43.478886 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c18b53f3-361d-4502-b2e3-5721c9fbbe6e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:43.502932 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c18b53f3-361d-4502-b2e3-5721c9fbbe6e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:43.504939 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c18b53f3-361d-4502-b2e3-5721c9fbbe6e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:43.506833 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c18b53f3-361d-4502-b2e3-5721c9fbbe6e tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.247138 Oct 28 12:22:43.519235 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 636/1293] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:43 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:44.526877 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ecd94c88-2d9e-4220-bdbf-30459337d3fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:44.527601 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ecd94c88-2d9e-4220-bdbf-30459337d3fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:44.535385 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ecd94c88-2d9e-4220-bdbf-30459337d3fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:44.535877 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ecd94c88-2d9e-4220-bdbf-30459337d3fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:44.536787 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ecd94c88-2d9e-4220-bdbf-30459337d3fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:44.537226 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ecd94c88-2d9e-4220-bdbf-30459337d3fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:44.729785 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ecd94c88-2d9e-4220-bdbf-30459337d3fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:44.742129 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ecd94c88-2d9e-4220-bdbf-30459337d3fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:44.748553 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ecd94c88-2d9e-4220-bdbf-30459337d3fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:44.750149 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ecd94c88-2d9e-4220-bdbf-30459337d3fa tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.227500 Oct 28 12:22:44.751025 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 658/1294] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:44 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:45.769153 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2dec3376-1c97-4c67-971c-e5f1bdd636b4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:45.770853 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2dec3376-1c97-4c67-971c-e5f1bdd636b4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:45.782057 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2dec3376-1c97-4c67-971c-e5f1bdd636b4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:45.782537 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2dec3376-1c97-4c67-971c-e5f1bdd636b4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:45.793236 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2dec3376-1c97-4c67-971c-e5f1bdd636b4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:45.793699 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2dec3376-1c97-4c67-971c-e5f1bdd636b4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:45.931045 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2dec3376-1c97-4c67-971c-e5f1bdd636b4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:45.939836 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2dec3376-1c97-4c67-971c-e5f1bdd636b4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:45.941329 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2dec3376-1c97-4c67-971c-e5f1bdd636b4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:45.942753 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2dec3376-1c97-4c67-971c-e5f1bdd636b4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.178125 Oct 28 12:22:45.954392 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 637/1295] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:45 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:46.962399 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8881c9d5-202c-4625-be92-71d0bc1d9756 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:46.963061 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8881c9d5-202c-4625-be92-71d0bc1d9756 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:46.969897 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8881c9d5-202c-4625-be92-71d0bc1d9756 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:46.971130 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8881c9d5-202c-4625-be92-71d0bc1d9756 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:46.971956 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8881c9d5-202c-4625-be92-71d0bc1d9756 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:46.972401 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8881c9d5-202c-4625-be92-71d0bc1d9756 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:47.098187 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8881c9d5-202c-4625-be92-71d0bc1d9756 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:47.105789 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8881c9d5-202c-4625-be92-71d0bc1d9756 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:47.107306 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8881c9d5-202c-4625-be92-71d0bc1d9756 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:47.108450 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8881c9d5-202c-4625-be92-71d0bc1d9756 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.150531 Oct 28 12:22:47.108997 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 659/1296] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:46 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:48.127005 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f7ba24f0-173e-48a6-95ea-bcd7310def88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:48.127626 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f7ba24f0-173e-48a6-95ea-bcd7310def88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:48.133560 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f7ba24f0-173e-48a6-95ea-bcd7310def88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:48.134001 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f7ba24f0-173e-48a6-95ea-bcd7310def88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:48.134915 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f7ba24f0-173e-48a6-95ea-bcd7310def88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:48.135349 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f7ba24f0-173e-48a6-95ea-bcd7310def88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:48.261924 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f7ba24f0-173e-48a6-95ea-bcd7310def88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:48.269742 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f7ba24f0-173e-48a6-95ea-bcd7310def88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:48.271250 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f7ba24f0-173e-48a6-95ea-bcd7310def88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:48.272398 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f7ba24f0-173e-48a6-95ea-bcd7310def88 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.149259 Oct 28 12:22:48.272947 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 638/1297] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:48 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:49.291329 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-11753266-0e51-408c-a8f0-ed8d5da9b69f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:49.291977 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-11753266-0e51-408c-a8f0-ed8d5da9b69f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:49.298150 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-11753266-0e51-408c-a8f0-ed8d5da9b69f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:49.299126 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-11753266-0e51-408c-a8f0-ed8d5da9b69f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:49.299890 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-11753266-0e51-408c-a8f0-ed8d5da9b69f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:49.300321 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-11753266-0e51-408c-a8f0-ed8d5da9b69f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:49.440464 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-11753266-0e51-408c-a8f0-ed8d5da9b69f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:49.448190 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-11753266-0e51-408c-a8f0-ed8d5da9b69f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:49.449671 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-11753266-0e51-408c-a8f0-ed8d5da9b69f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:49.450856 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-11753266-0e51-408c-a8f0-ed8d5da9b69f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.163330 Oct 28 12:22:49.451408 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 660/1298] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:49 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:50.469208 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d398d984-f0fe-4c97-9948-da2c41b42d4a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:50.469800 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d398d984-f0fe-4c97-9948-da2c41b42d4a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:50.477234 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d398d984-f0fe-4c97-9948-da2c41b42d4a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:50.478069 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d398d984-f0fe-4c97-9948-da2c41b42d4a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:50.478986 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d398d984-f0fe-4c97-9948-da2c41b42d4a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:50.479673 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d398d984-f0fe-4c97-9948-da2c41b42d4a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:50.619242 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d398d984-f0fe-4c97-9948-da2c41b42d4a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:50.627723 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d398d984-f0fe-4c97-9948-da2c41b42d4a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:50.629213 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d398d984-f0fe-4c97-9948-da2c41b42d4a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:50.630370 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d398d984-f0fe-4c97-9948-da2c41b42d4a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.165535 Oct 28 12:22:50.630959 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 639/1299] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:50 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:51.649362 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1995e605-b15e-451f-a414-63bb76c45783 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:51.649971 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1995e605-b15e-451f-a414-63bb76c45783 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:51.656256 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1995e605-b15e-451f-a414-63bb76c45783 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:51.656699 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1995e605-b15e-451f-a414-63bb76c45783 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:51.657453 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1995e605-b15e-451f-a414-63bb76c45783 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:51.657967 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1995e605-b15e-451f-a414-63bb76c45783 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:51.776430 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1995e605-b15e-451f-a414-63bb76c45783 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:51.784472 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1995e605-b15e-451f-a414-63bb76c45783 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:51.785953 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-1995e605-b15e-451f-a414-63bb76c45783 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:51.787114 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1995e605-b15e-451f-a414-63bb76c45783 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.141443 Oct 28 12:22:51.787692 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 661/1300] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:51 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:52.805248 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d1ab3176-77a1-4187-a286-c7b07a1f654d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:52.805828 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d1ab3176-77a1-4187-a286-c7b07a1f654d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:52.812038 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1ab3176-77a1-4187-a286-c7b07a1f654d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:52.812480 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1ab3176-77a1-4187-a286-c7b07a1f654d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:52.813236 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1ab3176-77a1-4187-a286-c7b07a1f654d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:52.816262 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d1ab3176-77a1-4187-a286-c7b07a1f654d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:52.934278 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d1ab3176-77a1-4187-a286-c7b07a1f654d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:52.942468 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d1ab3176-77a1-4187-a286-c7b07a1f654d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:52.943991 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d1ab3176-77a1-4187-a286-c7b07a1f654d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:52.945132 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d1ab3176-77a1-4187-a286-c7b07a1f654d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.143606 Oct 28 12:22:52.945690 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 640/1301] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:52 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:22:53.963169 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e8e31978-0003-41ba-90a5-a911641252ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:53.963752 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e8e31978-0003-41ba-90a5-a911641252ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:53.969803 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e8e31978-0003-41ba-90a5-a911641252ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:53.970785 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e8e31978-0003-41ba-90a5-a911641252ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:53.971563 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e8e31978-0003-41ba-90a5-a911641252ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:53.971985 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e8e31978-0003-41ba-90a5-a911641252ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:54.148946 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e8e31978-0003-41ba-90a5-a911641252ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:54.156563 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e8e31978-0003-41ba-90a5-a911641252ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:54.158033 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e8e31978-0003-41ba-90a5-a911641252ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:54.159245 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e8e31978-0003-41ba-90a5-a911641252ca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.199802 Oct 28 12:22:54.159795 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 662/1302] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:53 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:55.177096 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-dce66466-ee33-4323-9021-c5002e13fe11 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:55.177691 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-dce66466-ee33-4323-9021-c5002e13fe11 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:55.183848 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dce66466-ee33-4323-9021-c5002e13fe11 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:55.184287 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dce66466-ee33-4323-9021-c5002e13fe11 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:55.185041 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dce66466-ee33-4323-9021-c5002e13fe11 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:55.185463 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dce66466-ee33-4323-9021-c5002e13fe11 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:55.303372 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-dce66466-ee33-4323-9021-c5002e13fe11 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:55.311478 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-dce66466-ee33-4323-9021-c5002e13fe11 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:55.312961 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-dce66466-ee33-4323-9021-c5002e13fe11 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:55.314109 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-dce66466-ee33-4323-9021-c5002e13fe11 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.140774 Oct 28 12:22:55.314668 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 641/1303] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:55 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:56.333577 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8d86ddf2-3e46-445f-b180-51aa84e87072 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:56.334177 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8d86ddf2-3e46-445f-b180-51aa84e87072 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:56.340622 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8d86ddf2-3e46-445f-b180-51aa84e87072 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:56.341058 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8d86ddf2-3e46-445f-b180-51aa84e87072 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:56.341873 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8d86ddf2-3e46-445f-b180-51aa84e87072 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:56.342298 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8d86ddf2-3e46-445f-b180-51aa84e87072 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:56.461076 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8d86ddf2-3e46-445f-b180-51aa84e87072 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:56.468699 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8d86ddf2-3e46-445f-b180-51aa84e87072 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:56.470199 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8d86ddf2-3e46-445f-b180-51aa84e87072 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:56.471367 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8d86ddf2-3e46-445f-b180-51aa84e87072 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.142234 Oct 28 12:22:56.471916 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 663/1304] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:56 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:57.489340 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b5e3b5ce-e4ba-4d2e-a921-91ac0d1df631 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:57.489879 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b5e3b5ce-e4ba-4d2e-a921-91ac0d1df631 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:57.496148 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b5e3b5ce-e4ba-4d2e-a921-91ac0d1df631 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:57.496592 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b5e3b5ce-e4ba-4d2e-a921-91ac0d1df631 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:57.497362 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b5e3b5ce-e4ba-4d2e-a921-91ac0d1df631 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:57.497790 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b5e3b5ce-e4ba-4d2e-a921-91ac0d1df631 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:57.618000 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b5e3b5ce-e4ba-4d2e-a921-91ac0d1df631 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:57.626600 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b5e3b5ce-e4ba-4d2e-a921-91ac0d1df631 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:57.628285 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b5e3b5ce-e4ba-4d2e-a921-91ac0d1df631 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:57.629443 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b5e3b5ce-e4ba-4d2e-a921-91ac0d1df631 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.143956 Oct 28 12:22:57.630001 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 642/1305] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:57 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:58.647427 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ee348ca4-568c-4973-afb9-984759141cf4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:58.648032 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ee348ca4-568c-4973-afb9-984759141cf4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:58.655333 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee348ca4-568c-4973-afb9-984759141cf4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:58.655861 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee348ca4-568c-4973-afb9-984759141cf4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:58.657007 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee348ca4-568c-4973-afb9-984759141cf4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:58.658026 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ee348ca4-568c-4973-afb9-984759141cf4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:58.780529 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ee348ca4-568c-4973-afb9-984759141cf4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:58.788818 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ee348ca4-568c-4973-afb9-984759141cf4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:58.790310 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ee348ca4-568c-4973-afb9-984759141cf4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:58.791521 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ee348ca4-568c-4973-afb9-984759141cf4 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.147820 Oct 28 12:22:58.792095 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 664/1306] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:58 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:22:59.810276 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-082fece4-d82c-4cea-8c34-d2917b38021d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:22:59.810918 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-082fece4-d82c-4cea-8c34-d2917b38021d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:22:59.817129 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-082fece4-d82c-4cea-8c34-d2917b38021d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:59.817568 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-082fece4-d82c-4cea-8c34-d2917b38021d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:59.818326 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-082fece4-d82c-4cea-8c34-d2917b38021d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:22:59.818785 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-082fece4-d82c-4cea-8c34-d2917b38021d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:22:59.940987 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-082fece4-d82c-4cea-8c34-d2917b38021d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:59.949054 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-082fece4-d82c-4cea-8c34-d2917b38021d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:59.950540 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-082fece4-d82c-4cea-8c34-d2917b38021d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:22:59.951740 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-082fece4-d82c-4cea-8c34-d2917b38021d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.145093 Oct 28 12:22:59.952298 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 643/1307] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:22:59 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:23:00.195501 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-7295ee94-e25c-4a94-b143-a702edbccf74 req-d1fec273-c914-45af-b4c5-9407be004864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19635150-a15f-4d59-a3a3-adc15a411e40", "name": "network-vif-plugged", "status": "completed", "tag": "df78786b-91a7-4ab8-9ff2-b69bbf31776f"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:00.197132 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:23:00.197132 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:23:00.205802 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-7295ee94-e25c-4a94-b143-a702edbccf74 req-d1fec273-c914-45af-b4c5-9407be004864 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:00.206985 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-7295ee94-e25c-4a94-b143-a702edbccf74 req-d1fec273-c914-45af-b4c5-9407be004864 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:00.217929 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-7295ee94-e25c-4a94-b143-a702edbccf74 req-d1fec273-c914-45af-b4c5-9407be004864 service nova] Creating event network-vif-plugged:df78786b-91a7-4ab8-9ff2-b69bbf31776f for instance 19635150-a15f-4d59-a3a3-adc15a411e40 on hv-cinder-81571 Oct 28 12:23:00.222954 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-7295ee94-e25c-4a94-b143-a702edbccf74 req-d1fec273-c914-45af-b4c5-9407be004864 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031031 Oct 28 12:23:00.223560 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 665/1308] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:23:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:23:00.970357 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d19b382c-2507-4b4b-bc69-fc486d37841d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:00.970916 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d19b382c-2507-4b4b-bc69-fc486d37841d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:00.977154 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d19b382c-2507-4b4b-bc69-fc486d37841d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:00.977603 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d19b382c-2507-4b4b-bc69-fc486d37841d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:00.978366 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d19b382c-2507-4b4b-bc69-fc486d37841d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:00.978831 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d19b382c-2507-4b4b-bc69-fc486d37841d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:01.102472 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d19b382c-2507-4b4b-bc69-fc486d37841d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:01.110033 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d19b382c-2507-4b4b-bc69-fc486d37841d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:01.112032 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d19b382c-2507-4b4b-bc69-fc486d37841d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:01.113169 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d19b382c-2507-4b4b-bc69-fc486d37841d tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.146604 Oct 28 12:23:01.113721 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 644/1309] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:23:00 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:23:02.131409 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-28f3c3fc-7410-42c8-a274-f721e8002b21 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:02.132092 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-28f3c3fc-7410-42c8-a274-f721e8002b21 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:02.138621 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-28f3c3fc-7410-42c8-a274-f721e8002b21 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:02.139196 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-28f3c3fc-7410-42c8-a274-f721e8002b21 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:02.139965 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-28f3c3fc-7410-42c8-a274-f721e8002b21 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:02.140395 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-28f3c3fc-7410-42c8-a274-f721e8002b21 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:02.270449 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-28f3c3fc-7410-42c8-a274-f721e8002b21 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:02.278537 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-28f3c3fc-7410-42c8-a274-f721e8002b21 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:02.280219 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-28f3c3fc-7410-42c8-a274-f721e8002b21 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:02.281555 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-28f3c3fc-7410-42c8-a274-f721e8002b21 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1727 microversion: 2.20 time: 0.154175 Oct 28 12:23:02.282160 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 666/1310] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:23:02 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:23:03.300164 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-26df9bce-7b21-48d3-9933-994578901cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:03.300764 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-26df9bce-7b21-48d3-9933-994578901cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:03.307108 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-26df9bce-7b21-48d3-9933-994578901cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:03.307557 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-26df9bce-7b21-48d3-9933-994578901cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:03.308320 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-26df9bce-7b21-48d3-9933-994578901cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:03.308753 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-26df9bce-7b21-48d3-9933-994578901cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:03.429321 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-26df9bce-7b21-48d3-9933-994578901cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:03.436958 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-26df9bce-7b21-48d3-9933-994578901cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:03.438417 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-26df9bce-7b21-48d3-9933-994578901cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:03.440195 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-26df9bce-7b21-48d3-9933-994578901cf3 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1714 microversion: 2.20 time: 0.144340 Oct 28 12:23:03.440751 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 645/1311] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:23:03 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1714 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:23:05.142847 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-1cca6a6c-22e5-4774-8455-a22e8e8a5941 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:05.143790 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-1cca6a6c-22e5-4774-8455-a22e8e8a5941 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:05.149984 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1cca6a6c-22e5-4774-8455-a22e8e8a5941 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:05.150424 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1cca6a6c-22e5-4774-8455-a22e8e8a5941 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:05.151291 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1cca6a6c-22e5-4774-8455-a22e8e8a5941 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:05.151726 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-1cca6a6c-22e5-4774-8455-a22e8e8a5941 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:05.180084 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-1cca6a6c-22e5-4774-8455-a22e8e8a5941 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041805 Oct 28 12:23:05.180712 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 667/1312] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:23:05 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:23:05.234826 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c6e30db4-5f20-4571-81d5-2c65722549c8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:05.235323 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c6e30db4-5f20-4571-81d5-2c65722549c8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:05.241780 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6e30db4-5f20-4571-81d5-2c65722549c8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:05.242224 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6e30db4-5f20-4571-81d5-2c65722549c8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:05.243115 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6e30db4-5f20-4571-81d5-2c65722549c8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:05.243548 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c6e30db4-5f20-4571-81d5-2c65722549c8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:05.268147 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c6e30db4-5f20-4571-81d5-2c65722549c8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:23:05.340275 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c6e30db4-5f20-4571-81d5-2c65722549c8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 204 len: 0 microversion: 2.1 time: 0.108094 Oct 28 12:23:05.340275 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 646/1313] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:23:05 2021] DELETE /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:23:05.348735 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b919fa1d-a409-45cf-8921-3ac3fa52a0a9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:05.349504 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b919fa1d-a409-45cf-8921-3ac3fa52a0a9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:05.355316 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b919fa1d-a409-45cf-8921-3ac3fa52a0a9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:05.355765 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b919fa1d-a409-45cf-8921-3ac3fa52a0a9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:05.356530 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b919fa1d-a409-45cf-8921-3ac3fa52a0a9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:05.356959 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b919fa1d-a409-45cf-8921-3ac3fa52a0a9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:05.477444 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b919fa1d-a409-45cf-8921-3ac3fa52a0a9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:05.484622 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b919fa1d-a409-45cf-8921-3ac3fa52a0a9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1670 microversion: 2.1 time: 0.139800 Oct 28 12:23:05.485181 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 668/1314] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:05 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1670 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:06.501695 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2c9f606d-0d50-4640-a132-c926c484198e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:06.502390 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2c9f606d-0d50-4640-a132-c926c484198e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:06.508598 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c9f606d-0d50-4640-a132-c926c484198e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:06.509042 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c9f606d-0d50-4640-a132-c926c484198e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:06.509806 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c9f606d-0d50-4640-a132-c926c484198e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:06.510239 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2c9f606d-0d50-4640-a132-c926c484198e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:06.629072 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2c9f606d-0d50-4640-a132-c926c484198e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:06.636314 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2c9f606d-0d50-4640-a132-c926c484198e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1670 microversion: 2.1 time: 0.138660 Oct 28 12:23:06.636883 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 647/1315] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:06 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1670 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:07.653742 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e660b626-8db1-4fbe-af81-8dcc25233028 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:07.654357 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e660b626-8db1-4fbe-af81-8dcc25233028 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:07.661166 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e660b626-8db1-4fbe-af81-8dcc25233028 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:07.661617 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e660b626-8db1-4fbe-af81-8dcc25233028 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:07.662392 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e660b626-8db1-4fbe-af81-8dcc25233028 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:07.662866 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e660b626-8db1-4fbe-af81-8dcc25233028 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:07.741688 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e660b626-8db1-4fbe-af81-8dcc25233028 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:07.749071 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e660b626-8db1-4fbe-af81-8dcc25233028 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 200 len: 1603 microversion: 2.1 time: 0.098933 Oct 28 12:23:07.749769 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 669/1316] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:07 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 1603 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:07.924514 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-f22b0721-b7de-4ae4-862e-5cab3e06c04b req-88b2f33f-e052-4d05-a828-c246a174d092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3cfb902-8c2c-4a98-b226-147d495a83e9", "name": "network-vif-deleted", "tag": "162964eb-ccde-495d-a9be-489d9176ff3b"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:07.926095 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:23:07.926095 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:23:07.933282 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-f22b0721-b7de-4ae4-862e-5cab3e06c04b req-88b2f33f-e052-4d05-a828-c246a174d092 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:07.933600 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-f22b0721-b7de-4ae4-862e-5cab3e06c04b req-88b2f33f-e052-4d05-a828-c246a174d092 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:07.945348 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-f22b0721-b7de-4ae4-862e-5cab3e06c04b req-88b2f33f-e052-4d05-a828-c246a174d092 service nova] Creating event network-vif-deleted:162964eb-ccde-495d-a9be-489d9176ff3b for instance e3cfb902-8c2c-4a98-b226-147d495a83e9 on hv-cinder-81571 Oct 28 12:23:07.951069 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-f22b0721-b7de-4ae4-862e-5cab3e06c04b req-88b2f33f-e052-4d05-a828-c246a174d092 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178519 Oct 28 12:23:07.952163 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 648/1317] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:23:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:23:08.765217 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4527c47b-c2d7-4708-aeb6-83375cd9eab5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:08.765820 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4527c47b-c2d7-4708-aeb6-83375cd9eab5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:08.772890 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4527c47b-c2d7-4708-aeb6-83375cd9eab5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:08.773332 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4527c47b-c2d7-4708-aeb6-83375cd9eab5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:08.774166 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4527c47b-c2d7-4708-aeb6-83375cd9eab5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:08.774877 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4527c47b-c2d7-4708-aeb6-83375cd9eab5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:08.788997 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-4527c47b-c2d7-4708-aeb6-83375cd9eab5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] HTTP exception thrown: Instance e3cfb902-8c2c-4a98-b226-147d495a83e9 could not be found. Oct 28 12:23:08.789673 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4527c47b-c2d7-4708-aeb6-83375cd9eab5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Returning 404 to user: Instance e3cfb902-8c2c-4a98-b226-147d495a83e9 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:23:08.790406 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4527c47b-c2d7-4708-aeb6-83375cd9eab5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 404 len: 111 microversion: 2.1 time: 0.028953 Oct 28 12:23:08.790969 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 670/1318] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:08 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:23:08.800516 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6845e20f-ba38-427c-9375-f7f9ba7860fb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '.version_select at 0x7f11f819a940>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:08.823838 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6845e20f-ba38-427c-9375-f7f9ba7860fb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-104121" status: 202 len: 0 microversion: 2.1 time: 0.027962 Oct 28 12:23:08.824388 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 649/1319] 10.222.0.37 () {58 vars in 1208 bytes} [Thu Oct 28 12:23:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-104121 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:23:09.705214 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3559e7ad-dc29-4773-b83c-75c0855ecfdf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'create', calling method: .version_select at 0x7f11f367ab80>, body: {"keypair": {"name": "tempest-keypair-195437106"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:09.723037 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-3559e7ad-dc29-4773-b83c-75c0855ecfdf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Getting quotas for project 9312b8e64f51472da613ba9a553d6c08. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:23:09.726840 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-3559e7ad-dc29-4773-b83c-75c0855ecfdf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Getting quotas for user 32e4266183744daea8c01bd9f3b503e1 and project 9312b8e64f51472da613ba9a553d6c08. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:23:09.876744 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-3559e7ad-dc29-4773-b83c-75c0855ecfdf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Getting quotas for project 9312b8e64f51472da613ba9a553d6c08. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:23:09.880399 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-3559e7ad-dc29-4773-b83c-75c0855ecfdf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Getting quotas for user 32e4266183744daea8c01bd9f3b503e1 and project 9312b8e64f51472da613ba9a553d6c08. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:23:09.893332 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3559e7ad-dc29-4773-b83c-75c0855ecfdf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.191867 Oct 28 12:23:09.893919 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 671/1320] 10.222.0.37 () {60 vars in 1157 bytes} [Thu Oct 28 12:23:09 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:11.088098 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-375e1526-a001-4840-9763-842496a3125a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-826309538", "imageRef": "4385a199-a3e9-4c11-b580-60e7a24d0e97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de15b36d-2b79-466b-a06c-a72c17091769"}], "security_groups": [{"name": "tempest-securitygroup--604754767"}], "key_name": "tempest-keypair-195437106", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:11.184456 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-375e1526-a001-4840-9763-842496a3125a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] validate_networks() for [('de15b36d-2b79-466b-a06c-a72c17091769', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:23:11.646220 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-375e1526-a001-4840-9763-842496a3125a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:23:11.646651 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-375e1526-a001-4840-9763-842496a3125a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:23:11.647185 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-375e1526-a001-4840-9763-842496a3125a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:23:11.647592 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-375e1526-a001-4840-9763-842496a3125a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:23:11.648033 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-375e1526-a001-4840-9763-842496a3125a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:23:11.656491 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-375e1526-a001-4840-9763-842496a3125a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:11.656987 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-375e1526-a001-4840-9763-842496a3125a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:11.657741 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-375e1526-a001-4840-9763-842496a3125a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:11.658176 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-375e1526-a001-4840-9763-842496a3125a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:11.675296 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-375e1526-a001-4840-9763-842496a3125a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Getting quotas for project 9312b8e64f51472da613ba9a553d6c08. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:23:11.679140 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-375e1526-a001-4840-9763-842496a3125a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Getting quotas for user 32e4266183744daea8c01bd9f3b503e1 and project 9312b8e64f51472da613ba9a553d6c08. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:23:11.690186 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-375e1526-a001-4840-9763-842496a3125a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:23:11.692608 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-375e1526-a001-4840-9763-842496a3125a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4385a199-a3e9-4c11-b580-60e7a24d0e97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:23:11.738453 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-375e1526-a001-4840-9763-842496a3125a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.654254 Oct 28 12:23:11.739398 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 650/1321] 10.222.0.37 () {60 vars in 1146 bytes} [Thu Oct 28 12:23:11 2021] POST /compute/v2.1/servers => generated 401 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:23:11.749447 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-27fa1c53-598b-4c90-8fa5-6a880ab1fe52 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:11.750234 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-27fa1c53-598b-4c90-8fa5-6a880ab1fe52 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:11.802465 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-27fa1c53-598b-4c90-8fa5-6a880ab1fe52 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:11.808988 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-27fa1c53-598b-4c90-8fa5-6a880ab1fe52 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43" status: 200 len: 1236 microversion: 2.1 time: 0.063682 Oct 28 12:23:11.809540 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 672/1322] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:11 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 => generated 1236 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:12.826708 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-144985ae-01d5-4ca0-b536-2974b1ea952c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:12.827376 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-144985ae-01d5-4ca0-b536-2974b1ea952c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:12.835006 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-144985ae-01d5-4ca0-b536-2974b1ea952c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:12.835457 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-144985ae-01d5-4ca0-b536-2974b1ea952c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:12.836239 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-144985ae-01d5-4ca0-b536-2974b1ea952c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:12.836792 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-144985ae-01d5-4ca0-b536-2974b1ea952c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:12.899337 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-144985ae-01d5-4ca0-b536-2974b1ea952c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:12.906583 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-144985ae-01d5-4ca0-b536-2974b1ea952c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43" status: 200 len: 1294 microversion: 2.1 time: 0.084043 Oct 28 12:23:12.907260 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 651/1323] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:12 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:13.924231 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f3078a05-28a6-40fa-aa74-b9cc3605a735 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:13.925450 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f3078a05-28a6-40fa-aa74-b9cc3605a735 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:13.932377 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3078a05-28a6-40fa-aa74-b9cc3605a735 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:13.933402 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3078a05-28a6-40fa-aa74-b9cc3605a735 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:13.934395 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3078a05-28a6-40fa-aa74-b9cc3605a735 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:13.935054 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f3078a05-28a6-40fa-aa74-b9cc3605a735 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:14.045869 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-260bf263-0dbc-4157-9c4c-7aa8c4cc5338 req-2aa96b00-f474-49e4-8dd4-1a92443181c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b36bb8ba-2277-44a6-afc5-82fb6b3c2f43", "tag": "502a1ac2-2e78-4cbb-91b0-ce62e1165360"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:14.051794 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:23:14.051794 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:23:14.065776 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-260bf263-0dbc-4157-9c4c-7aa8c4cc5338 req-2aa96b00-f474-49e4-8dd4-1a92443181c3 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:14.066254 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-260bf263-0dbc-4157-9c4c-7aa8c4cc5338 req-2aa96b00-f474-49e4-8dd4-1a92443181c3 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:14.077698 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-260bf263-0dbc-4157-9c4c-7aa8c4cc5338 req-2aa96b00-f474-49e4-8dd4-1a92443181c3 service nova] Creating event network-changed:502a1ac2-2e78-4cbb-91b0-ce62e1165360 for instance b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 on hv-cinder-81571 Oct 28 12:23:14.083200 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-260bf263-0dbc-4157-9c4c-7aa8c4cc5338 req-2aa96b00-f474-49e4-8dd4-1a92443181c3 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041969 Oct 28 12:23:14.084402 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 652/1324] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:23:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:23:14.169357 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f3078a05-28a6-40fa-aa74-b9cc3605a735 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:14.177577 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f3078a05-28a6-40fa-aa74-b9cc3605a735 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43" status: 200 len: 1361 microversion: 2.1 time: 0.257430 Oct 28 12:23:14.178560 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 673/1325] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:13 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 => generated 1361 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:15.195969 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bc3c7cb4-8303-48e0-8544-ae066d8c4e84 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:15.196677 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bc3c7cb4-8303-48e0-8544-ae066d8c4e84 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:15.202780 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc3c7cb4-8303-48e0-8544-ae066d8c4e84 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:15.203232 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc3c7cb4-8303-48e0-8544-ae066d8c4e84 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:15.204657 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc3c7cb4-8303-48e0-8544-ae066d8c4e84 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:15.205087 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bc3c7cb4-8303-48e0-8544-ae066d8c4e84 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:15.323801 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bc3c7cb4-8303-48e0-8544-ae066d8c4e84 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:15.330920 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bc3c7cb4-8303-48e0-8544-ae066d8c4e84 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43" status: 200 len: 1361 microversion: 2.1 time: 0.139508 Oct 28 12:23:15.331487 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 653/1326] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:15 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 => generated 1361 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:16.347548 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9a82e13f-9096-41ee-8338-296986b4c972 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:16.348154 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9a82e13f-9096-41ee-8338-296986b4c972 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:16.354419 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9a82e13f-9096-41ee-8338-296986b4c972 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:16.354905 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9a82e13f-9096-41ee-8338-296986b4c972 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:16.355679 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9a82e13f-9096-41ee-8338-296986b4c972 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:16.356109 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9a82e13f-9096-41ee-8338-296986b4c972 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:16.478553 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-9a82e13f-9096-41ee-8338-296986b4c972 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:16.486656 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9a82e13f-9096-41ee-8338-296986b4c972 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43" status: 200 len: 1361 microversion: 2.1 time: 0.142676 Oct 28 12:23:16.487236 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 674/1327] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:16 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 => generated 1361 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:23:17.502665 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-72c4ed9a-b7ae-4b81-bd30-aea5fe40b3a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:17.503290 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-72c4ed9a-b7ae-4b81-bd30-aea5fe40b3a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:17.509643 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-72c4ed9a-b7ae-4b81-bd30-aea5fe40b3a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:17.510082 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-72c4ed9a-b7ae-4b81-bd30-aea5fe40b3a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:17.510882 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-72c4ed9a-b7ae-4b81-bd30-aea5fe40b3a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:17.511315 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-72c4ed9a-b7ae-4b81-bd30-aea5fe40b3a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:17.639006 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-72c4ed9a-b7ae-4b81-bd30-aea5fe40b3a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:17.646659 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-72c4ed9a-b7ae-4b81-bd30-aea5fe40b3a7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43" status: 200 len: 1361 microversion: 2.1 time: 0.147731 Oct 28 12:23:17.647246 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 654/1328] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:17 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:18.663890 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-80356a57-065c-450f-b7ba-c164f5970cba tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:18.664503 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-80356a57-065c-450f-b7ba-c164f5970cba tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:18.670771 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-80356a57-065c-450f-b7ba-c164f5970cba tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:18.671217 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-80356a57-065c-450f-b7ba-c164f5970cba tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:18.672053 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-80356a57-065c-450f-b7ba-c164f5970cba tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:18.672486 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-80356a57-065c-450f-b7ba-c164f5970cba tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:18.792845 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-80356a57-065c-450f-b7ba-c164f5970cba tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:18.800191 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-80356a57-065c-450f-b7ba-c164f5970cba tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43" status: 200 len: 1361 microversion: 2.1 time: 0.140255 Oct 28 12:23:18.800743 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 675/1329] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:18 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 => generated 1361 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:19.815962 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c0fa04a6-d2e0-4d81-bf6c-185bba320bdf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:19.816650 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c0fa04a6-d2e0-4d81-bf6c-185bba320bdf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:19.822754 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0fa04a6-d2e0-4d81-bf6c-185bba320bdf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:19.823197 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0fa04a6-d2e0-4d81-bf6c-185bba320bdf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:19.823959 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0fa04a6-d2e0-4d81-bf6c-185bba320bdf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:19.824381 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0fa04a6-d2e0-4d81-bf6c-185bba320bdf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:19.945540 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c0fa04a6-d2e0-4d81-bf6c-185bba320bdf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:19.952567 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c0fa04a6-d2e0-4d81-bf6c-185bba320bdf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43" status: 200 len: 1361 microversion: 2.1 time: 0.140240 Oct 28 12:23:19.953130 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 655/1330] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:19 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 => generated 1361 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:20.399565 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-5a57f78a-7cb7-4094-a798-db0904b75b6d req-7bbc7c56-6e87-48fc-a058-7b1a7c4aef5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36bb8ba-2277-44a6-afc5-82fb6b3c2f43", "name": "network-vif-plugged", "status": "completed", "tag": "502a1ac2-2e78-4cbb-91b0-ce62e1165360"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:20.401221 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:23:20.401221 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:23:20.408042 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-5a57f78a-7cb7-4094-a798-db0904b75b6d req-7bbc7c56-6e87-48fc-a058-7b1a7c4aef5d service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:20.408468 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-5a57f78a-7cb7-4094-a798-db0904b75b6d req-7bbc7c56-6e87-48fc-a058-7b1a7c4aef5d service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:20.419838 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-5a57f78a-7cb7-4094-a798-db0904b75b6d req-7bbc7c56-6e87-48fc-a058-7b1a7c4aef5d service nova] Creating event network-vif-plugged:502a1ac2-2e78-4cbb-91b0-ce62e1165360 for instance b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 on hv-cinder-81571 Oct 28 12:23:20.424691 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-5a57f78a-7cb7-4094-a798-db0904b75b6d req-7bbc7c56-6e87-48fc-a058-7b1a7c4aef5d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091856 Oct 28 12:23:20.425311 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 676/1331] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:23:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:23:20.969615 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-79666eb5-ccf2-41c2-9097-1a90da68f6ad tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:20.970144 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-79666eb5-ccf2-41c2-9097-1a90da68f6ad tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:20.976308 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79666eb5-ccf2-41c2-9097-1a90da68f6ad tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:20.976748 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79666eb5-ccf2-41c2-9097-1a90da68f6ad tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:20.977505 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79666eb5-ccf2-41c2-9097-1a90da68f6ad tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:20.977963 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-79666eb5-ccf2-41c2-9097-1a90da68f6ad tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:21.096230 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-79666eb5-ccf2-41c2-9097-1a90da68f6ad tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:21.103407 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-79666eb5-ccf2-41c2-9097-1a90da68f6ad tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43" status: 200 len: 1361 microversion: 2.1 time: 0.137982 Oct 28 12:23:21.103971 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 656/1332] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:20 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 => generated 1361 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:21.356807 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-61cc76fe-2eee-48e3-a9cf-633c6b0835c8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:21.357332 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-61cc76fe-2eee-48e3-a9cf-633c6b0835c8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:21.363429 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-61cc76fe-2eee-48e3-a9cf-633c6b0835c8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:21.363874 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-61cc76fe-2eee-48e3-a9cf-633c6b0835c8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:21.364635 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-61cc76fe-2eee-48e3-a9cf-633c6b0835c8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:21.365065 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-61cc76fe-2eee-48e3-a9cf-633c6b0835c8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:21.388341 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-61cc76fe-2eee-48e3-a9cf-633c6b0835c8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:23:21.460920 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-61cc76fe-2eee-48e3-a9cf-633c6b0835c8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "DELETE /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 204 len: 0 microversion: 2.1 time: 0.108433 Oct 28 12:23:21.461638 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 677/1333] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:23:21 2021] DELETE /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:23:21.469871 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-40deaaba-6665-4c60-9b69-174872189600 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:21.470480 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-40deaaba-6665-4c60-9b69-174872189600 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:21.476192 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-40deaaba-6665-4c60-9b69-174872189600 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:21.476635 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-40deaaba-6665-4c60-9b69-174872189600 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:21.477397 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-40deaaba-6665-4c60-9b69-174872189600 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:21.477828 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-40deaaba-6665-4c60-9b69-174872189600 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:21.597155 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-40deaaba-6665-4c60-9b69-174872189600 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:21.604437 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-40deaaba-6665-4c60-9b69-174872189600 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1576 microversion: 2.1 time: 0.138870 Oct 28 12:23:21.604998 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 657/1334] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:21 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1576 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:22.120610 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5611d484-29c0-49ce-a654-a58249958ba3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:22.121305 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5611d484-29c0-49ce-a654-a58249958ba3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:22.127176 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5611d484-29c0-49ce-a654-a58249958ba3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:22.127572 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5611d484-29c0-49ce-a654-a58249958ba3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:22.128368 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5611d484-29c0-49ce-a654-a58249958ba3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:22.128802 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5611d484-29c0-49ce-a654-a58249958ba3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:22.251415 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5611d484-29c0-49ce-a654-a58249958ba3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:22.258794 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5611d484-29c0-49ce-a654-a58249958ba3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43" status: 200 len: 1546 microversion: 2.1 time: 0.142278 Oct 28 12:23:22.259494 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 678/1335] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:22 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 => generated 1546 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:22.275435 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ac6ca8be-178a-419b-9509-fb72ec9fe566 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:22.275946 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ac6ca8be-178a-419b-9509-fb72ec9fe566 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:22.282990 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac6ca8be-178a-419b-9509-fb72ec9fe566 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:22.283441 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac6ca8be-178a-419b-9509-fb72ec9fe566 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:22.284223 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac6ca8be-178a-419b-9509-fb72ec9fe566 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:22.284654 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac6ca8be-178a-419b-9509-fb72ec9fe566 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:22.378824 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ac6ca8be-178a-419b-9509-fb72ec9fe566 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107145 Oct 28 12:23:22.379423 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 658/1336] 10.222.0.37 () {58 vars in 1274 bytes} [Thu Oct 28 12:23:22 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:23:22.621091 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fad33a05-5f77-4679-a1cf-0d863006850f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:22.621730 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fad33a05-5f77-4679-a1cf-0d863006850f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:22.628806 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fad33a05-5f77-4679-a1cf-0d863006850f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:22.629335 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fad33a05-5f77-4679-a1cf-0d863006850f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:22.630062 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fad33a05-5f77-4679-a1cf-0d863006850f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:22.630493 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fad33a05-5f77-4679-a1cf-0d863006850f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:22.754741 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-fad33a05-5f77-4679-a1cf-0d863006850f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:22.762769 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fad33a05-5f77-4679-a1cf-0d863006850f tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1576 microversion: 2.1 time: 0.145521 Oct 28 12:23:22.763443 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 679/1337] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:22 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1576 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:23.369209 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6c2337c9-57da-49eb-88fa-7d396b2f6086 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:23.370159 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6c2337c9-57da-49eb-88fa-7d396b2f6086 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:23.374498 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-b9d6ba98-1592-423d-86f4-6b724856ac94 req-68a1f65a-9078-427c-9b60-688f261c697d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b36bb8ba-2277-44a6-afc5-82fb6b3c2f43", "tag": "502a1ac2-2e78-4cbb-91b0-ce62e1165360"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:23.376827 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:23:23.376827 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:23:23.383678 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-b9d6ba98-1592-423d-86f4-6b724856ac94 req-68a1f65a-9078-427c-9b60-688f261c697d service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:23.384120 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-b9d6ba98-1592-423d-86f4-6b724856ac94 req-68a1f65a-9078-427c-9b60-688f261c697d service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:23.386057 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c2337c9-57da-49eb-88fa-7d396b2f6086 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:23.387251 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c2337c9-57da-49eb-88fa-7d396b2f6086 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:23.388229 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c2337c9-57da-49eb-88fa-7d396b2f6086 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:23.388671 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6c2337c9-57da-49eb-88fa-7d396b2f6086 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:23.396936 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-b9d6ba98-1592-423d-86f4-6b724856ac94 req-68a1f65a-9078-427c-9b60-688f261c697d service nova] Creating event network-changed:502a1ac2-2e78-4cbb-91b0-ce62e1165360 for instance b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 on hv-cinder-81571 Oct 28 12:23:23.402235 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-b9d6ba98-1592-423d-86f4-6b724856ac94 req-68a1f65a-9078-427c-9b60-688f261c697d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032275 Oct 28 12:23:23.403382 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 680/1338] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:23:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:23:23.462992 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6c2337c9-57da-49eb-88fa-7d396b2f6086 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 14 microversion: 2.1 time: 0.097205 Oct 28 12:23:23.467184 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 659/1339] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:23 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 12:23:23.782497 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4f943844-ee91-4dc3-a2ef-54f9e072ca4e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:23.785019 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4f943844-ee91-4dc3-a2ef-54f9e072ca4e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:23.793277 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4f943844-ee91-4dc3-a2ef-54f9e072ca4e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:23.793996 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4f943844-ee91-4dc3-a2ef-54f9e072ca4e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:23.794993 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4f943844-ee91-4dc3-a2ef-54f9e072ca4e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:23.795425 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4f943844-ee91-4dc3-a2ef-54f9e072ca4e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:24.176762 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-4f943844-ee91-4dc3-a2ef-54f9e072ca4e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:24.185136 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4f943844-ee91-4dc3-a2ef-54f9e072ca4e tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1576 microversion: 2.1 time: 0.406684 Oct 28 12:23:24.185919 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 681/1340] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:23 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1576 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:24.477157 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-99ebde0b-7f4b-4497-886b-989d31385dcc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:24.478553 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-99ebde0b-7f4b-4497-886b-989d31385dcc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:24.488527 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-99ebde0b-7f4b-4497-886b-989d31385dcc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:24.489142 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-99ebde0b-7f4b-4497-886b-989d31385dcc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:24.490242 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-99ebde0b-7f4b-4497-886b-989d31385dcc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:24.490883 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-99ebde0b-7f4b-4497-886b-989d31385dcc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:24.559905 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-99ebde0b-7f4b-4497-886b-989d31385dcc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 14 microversion: 2.1 time: 0.088563 Oct 28 12:23:24.563858 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 660/1341] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:24 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:23:24.627953 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-2c44d04d-95dd-43ba-8077-81412b375fc5 req-1562cbd7-d991-41c7-82f1-c987e9cab460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f8b97f-0bb9-426b-939a-83aec5bd97be", "name": "network-vif-deleted", "tag": "695c0857-cf64-4a4c-9dc1-67c7d611fbf6"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:24.629752 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:23:24.629752 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:23:24.637503 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-2c44d04d-95dd-43ba-8077-81412b375fc5 req-1562cbd7-d991-41c7-82f1-c987e9cab460 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:24.638378 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-2c44d04d-95dd-43ba-8077-81412b375fc5 req-1562cbd7-d991-41c7-82f1-c987e9cab460 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:24.652090 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-2c44d04d-95dd-43ba-8077-81412b375fc5 req-1562cbd7-d991-41c7-82f1-c987e9cab460 service nova] Creating event network-vif-deleted:695c0857-cf64-4a4c-9dc1-67c7d611fbf6 for instance 99f8b97f-0bb9-426b-939a-83aec5bd97be on hv-cinder-81571 Oct 28 12:23:24.657975 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-2c44d04d-95dd-43ba-8077-81412b375fc5 req-1562cbd7-d991-41c7-82f1-c987e9cab460 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033637 Oct 28 12:23:24.659037 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 682/1342] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:23:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:23:25.205187 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3b92268a-5048-423c-ba5e-e22fe27600c3 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:25.206156 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3b92268a-5048-423c-ba5e-e22fe27600c3 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:25.213856 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3b92268a-5048-423c-ba5e-e22fe27600c3 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:25.214304 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3b92268a-5048-423c-ba5e-e22fe27600c3 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:25.215170 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3b92268a-5048-423c-ba5e-e22fe27600c3 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:25.215601 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3b92268a-5048-423c-ba5e-e22fe27600c3 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:25.251961 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3b92268a-5048-423c-ba5e-e22fe27600c3 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:25.252411 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3b92268a-5048-423c-ba5e-e22fe27600c3 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:25.252869 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-3b92268a-5048-423c-ba5e-e22fe27600c3 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lazy-loading 'fault' on Instance uuid 99f8b97f-0bb9-426b-939a-83aec5bd97be {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:23:25.299352 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3b92268a-5048-423c-ba5e-e22fe27600c3 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:25.306837 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3b92268a-5048-423c-ba5e-e22fe27600c3 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 200 len: 1229 microversion: 2.1 time: 0.107629 Oct 28 12:23:25.307415 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 661/1343] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:25 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 1229 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:25.576403 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-97da9654-5d7b-4df8-8c18-d68b63a0f262 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:25.578160 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-97da9654-5d7b-4df8-8c18-d68b63a0f262 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:25.586137 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-97da9654-5d7b-4df8-8c18-d68b63a0f262 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:25.586574 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-97da9654-5d7b-4df8-8c18-d68b63a0f262 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:25.587443 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-97da9654-5d7b-4df8-8c18-d68b63a0f262 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:25.587801 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-97da9654-5d7b-4df8-8c18-d68b63a0f262 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:25.653210 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-97da9654-5d7b-4df8-8c18-d68b63a0f262 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 14 microversion: 2.1 time: 0.084876 Oct 28 12:23:25.653749 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 683/1344] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:25 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:23:26.324761 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fc5c7580-dbad-4448-acb6-684c82364f59 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:26.325358 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-fc5c7580-dbad-4448-acb6-684c82364f59 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:26.332049 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fc5c7580-dbad-4448-acb6-684c82364f59 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:26.332502 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fc5c7580-dbad-4448-acb6-684c82364f59 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:26.333296 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fc5c7580-dbad-4448-acb6-684c82364f59 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:26.333733 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-fc5c7580-dbad-4448-acb6-684c82364f59 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:26.351772 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-fc5c7580-dbad-4448-acb6-684c82364f59 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] HTTP exception thrown: Instance 99f8b97f-0bb9-426b-939a-83aec5bd97be could not be found. Oct 28 12:23:26.352375 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-fc5c7580-dbad-4448-acb6-684c82364f59 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Returning 404 to user: Instance 99f8b97f-0bb9-426b-939a-83aec5bd97be could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:23:26.353207 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-fc5c7580-dbad-4448-acb6-684c82364f59 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 404 len: 111 microversion: 2.1 time: 0.032343 Oct 28 12:23:26.353767 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 662/1345] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:26 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:23:26.494149 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-beb07cec-ee8e-4a50-84d1-aee77b1dc806 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-345539857", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-372409146", "security_groups": [{"name": "tempest-secgroup-smoke-1117697042"}], "block_device_mapping_v2": [{"uuid": "6eb51f8a-a31e-4a5a-a265-6d72713a3579", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0274befd-d9a1-4ff6-a2b6-a21e079de445"}]}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:26.592951 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.network.neutron [None req-beb07cec-ee8e-4a50-84d1-aee77b1dc806 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] validate_networks() for [('0274befd-d9a1-4ff6-a2b6-a21e079de445', None, None, None, None, None)] {{(pid=115798) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:23:26.664371 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1a98c7a7-3651-400e-b1a5-c8114b571801 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:26.665362 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1a98c7a7-3651-400e-b1a5-c8114b571801 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:26.671712 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a98c7a7-3651-400e-b1a5-c8114b571801 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:26.672155 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a98c7a7-3651-400e-b1a5-c8114b571801 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:26.672922 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a98c7a7-3651-400e-b1a5-c8114b571801 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:26.673355 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a98c7a7-3651-400e-b1a5-c8114b571801 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:26.736678 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1a98c7a7-3651-400e-b1a5-c8114b571801 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 14 microversion: 2.1 time: 0.075776 Oct 28 12:23:26.739917 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 663/1346] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:26 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 12:23:27.026979 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-beb07cec-ee8e-4a50-84d1-aee77b1dc806 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Flavor limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:23:27.027704 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-beb07cec-ee8e-4a50-84d1-aee77b1dc806 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Image limits 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:23:27.028598 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-beb07cec-ee8e-4a50-84d1-aee77b1dc806 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Flavor pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:23:27.029325 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-beb07cec-ee8e-4a50-84d1-aee77b1dc806 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Image pref 0:0:0 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:23:27.030034 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.virt.hardware [None req-beb07cec-ee8e-4a50-84d1-aee77b1dc806 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:23:27.040129 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-beb07cec-ee8e-4a50-84d1-aee77b1dc806 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:27.040565 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-beb07cec-ee8e-4a50-84d1-aee77b1dc806 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:27.041413 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-beb07cec-ee8e-4a50-84d1-aee77b1dc806 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:27.041846 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-beb07cec-ee8e-4a50-84d1-aee77b1dc806 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:27.058756 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-beb07cec-ee8e-4a50-84d1-aee77b1dc806 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Getting quotas for project cfa9219e414f4bd49dcbf215ed8d6f35. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:23:27.063185 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-beb07cec-ee8e-4a50-84d1-aee77b1dc806 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Getting quotas for user 9cb6619f170a4a2295b89558706885bc and project cfa9219e414f4bd49dcbf215ed8d6f35. Resources: {'cores', 'instances', 'ram'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:23:27.118267 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-beb07cec-ee8e-4a50-84d1-aee77b1dc806 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Going to run 1 instances... {{(pid=115798) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:23:27.120570 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-beb07cec-ee8e-4a50-84d1-aee77b1dc806 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6eb51f8a-a31e-4a5a-a265-6d72713a3579',volume_size=None,volume_type=None)] {{(pid=115798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:23:27.243266 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-beb07cec-ee8e-4a50-84d1-aee77b1dc806 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.752998 Oct 28 12:23:27.244080 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 684/1347] 10.222.0.37 () {60 vars in 1146 bytes} [Thu Oct 28 12:23:26 2021] POST /compute/v2.1/servers => generated 406 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:23:27.254673 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1d534de6-736e-4898-9d90-f8f9b50575b2 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:27.255394 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1d534de6-736e-4898-9d90-f8f9b50575b2 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:27.313979 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1d534de6-736e-4898-9d90-f8f9b50575b2 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:27.320314 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1d534de6-736e-4898-9d90-f8f9b50575b2 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 200 len: 1093 microversion: 2.1 time: 0.070155 Oct 28 12:23:27.320876 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 664/1348] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:27 2021] GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:23:27.748003 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5619ed1b-3ac9-4d4b-8983-bc00d8341799 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:27.748984 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5619ed1b-3ac9-4d4b-8983-bc00d8341799 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:27.756558 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5619ed1b-3ac9-4d4b-8983-bc00d8341799 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:27.757098 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5619ed1b-3ac9-4d4b-8983-bc00d8341799 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:27.758101 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5619ed1b-3ac9-4d4b-8983-bc00d8341799 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:27.758612 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5619ed1b-3ac9-4d4b-8983-bc00d8341799 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:27.816479 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5619ed1b-3ac9-4d4b-8983-bc00d8341799 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 14 microversion: 2.1 time: 0.072413 Oct 28 12:23:27.819217 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 685/1349] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:27 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:23:28.337349 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-705ec2a5-2d4f-49a6-996b-3eb8beae1fce tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:28.338049 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-705ec2a5-2d4f-49a6-996b-3eb8beae1fce tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:28.344724 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-705ec2a5-2d4f-49a6-996b-3eb8beae1fce tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:28.345810 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-705ec2a5-2d4f-49a6-996b-3eb8beae1fce tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:28.346581 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-705ec2a5-2d4f-49a6-996b-3eb8beae1fce tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:28.347035 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-705ec2a5-2d4f-49a6-996b-3eb8beae1fce tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:28.409613 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-705ec2a5-2d4f-49a6-996b-3eb8beae1fce tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:28.417054 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-705ec2a5-2d4f-49a6-996b-3eb8beae1fce tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 200 len: 1209 microversion: 2.1 time: 0.083498 Oct 28 12:23:28.417897 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 665/1350] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:28 2021] GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:28.828287 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2a689b86-21e4-4476-ba71-0921d4121a3a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:28.829346 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2a689b86-21e4-4476-ba71-0921d4121a3a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:28.835762 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2a689b86-21e4-4476-ba71-0921d4121a3a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:28.836205 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2a689b86-21e4-4476-ba71-0921d4121a3a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:28.837167 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2a689b86-21e4-4476-ba71-0921d4121a3a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:28.837593 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2a689b86-21e4-4476-ba71-0921d4121a3a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:28.901496 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2a689b86-21e4-4476-ba71-0921d4121a3a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 14 microversion: 2.1 time: 0.077422 Oct 28 12:23:28.902135 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 686/1351] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:28 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 12:23:29.433089 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-25592e0f-e37a-48d0-8b2c-17762674aca4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:29.433831 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-25592e0f-e37a-48d0-8b2c-17762674aca4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:29.440276 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-25592e0f-e37a-48d0-8b2c-17762674aca4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:29.440740 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-25592e0f-e37a-48d0-8b2c-17762674aca4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:29.441760 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-25592e0f-e37a-48d0-8b2c-17762674aca4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:29.442265 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-25592e0f-e37a-48d0-8b2c-17762674aca4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:29.470639 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-90241bff-a332-44f0-b457-66ffbabac6b1 req-3881c36e-d793-46b2-9edd-3b2ffc961c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4023905f-5420-4e27-99bd-a9465bb7c9ac", "tag": "27692bcf-cac2-47f5-bc7e-a77918b203e2"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:29.472186 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:23:29.472186 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:23:29.489242 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-90241bff-a332-44f0-b457-66ffbabac6b1 req-3881c36e-d793-46b2-9edd-3b2ffc961c4c service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:29.489774 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-90241bff-a332-44f0-b457-66ffbabac6b1 req-3881c36e-d793-46b2-9edd-3b2ffc961c4c service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:29.503293 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-90241bff-a332-44f0-b457-66ffbabac6b1 req-3881c36e-d793-46b2-9edd-3b2ffc961c4c service nova] Creating event network-changed:27692bcf-cac2-47f5-bc7e-a77918b203e2 for instance 4023905f-5420-4e27-99bd-a9465bb7c9ac on hv-cinder-81571 Oct 28 12:23:29.508311 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-90241bff-a332-44f0-b457-66ffbabac6b1 req-3881c36e-d793-46b2-9edd-3b2ffc961c4c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042692 Oct 28 12:23:29.508961 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 687/1352] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:23:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:23:29.597088 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-25592e0f-e37a-48d0-8b2c-17762674aca4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:29.604948 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-25592e0f-e37a-48d0-8b2c-17762674aca4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 200 len: 1265 microversion: 2.1 time: 0.175389 Oct 28 12:23:29.605529 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 666/1353] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:29 2021] GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:23:29.913298 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8c9d9a37-feab-4b56-a43a-de61f7376537 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:29.914283 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8c9d9a37-feab-4b56-a43a-de61f7376537 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:29.920593 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c9d9a37-feab-4b56-a43a-de61f7376537 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:29.921038 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c9d9a37-feab-4b56-a43a-de61f7376537 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:29.921808 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c9d9a37-feab-4b56-a43a-de61f7376537 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:29.922240 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8c9d9a37-feab-4b56-a43a-de61f7376537 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:29.980482 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8c9d9a37-feab-4b56-a43a-de61f7376537 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 14 microversion: 2.1 time: 0.071398 Oct 28 12:23:29.981032 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 688/1354] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:29 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 12:23:30.621419 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d900a6cb-de94-4867-8ba9-c957570c9c43 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:30.622025 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d900a6cb-de94-4867-8ba9-c957570c9c43 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:30.628603 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d900a6cb-de94-4867-8ba9-c957570c9c43 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:30.629536 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d900a6cb-de94-4867-8ba9-c957570c9c43 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:30.629827 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d900a6cb-de94-4867-8ba9-c957570c9c43 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:30.630264 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d900a6cb-de94-4867-8ba9-c957570c9c43 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:30.752567 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d900a6cb-de94-4867-8ba9-c957570c9c43 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:30.759738 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d900a6cb-de94-4867-8ba9-c957570c9c43 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 200 len: 1265 microversion: 2.1 time: 0.142280 Oct 28 12:23:30.760311 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 667/1355] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:30 2021] GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:30.993315 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-559337b1-9b54-47e7-9425-0211b5d9d0a3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:30.994297 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-559337b1-9b54-47e7-9425-0211b5d9d0a3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:31.001548 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-559337b1-9b54-47e7-9425-0211b5d9d0a3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:31.001986 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-559337b1-9b54-47e7-9425-0211b5d9d0a3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:31.002764 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-559337b1-9b54-47e7-9425-0211b5d9d0a3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:31.003194 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-559337b1-9b54-47e7-9425-0211b5d9d0a3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:31.062096 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-559337b1-9b54-47e7-9425-0211b5d9d0a3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 14 microversion: 2.1 time: 0.072989 Oct 28 12:23:31.062866 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 689/1356] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:30 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 12:23:31.776421 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b982319d-e2e1-4969-983a-5a6dae5f3a31 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:31.777061 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b982319d-e2e1-4969-983a-5a6dae5f3a31 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:31.783994 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b982319d-e2e1-4969-983a-5a6dae5f3a31 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:31.784436 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b982319d-e2e1-4969-983a-5a6dae5f3a31 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:31.785199 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b982319d-e2e1-4969-983a-5a6dae5f3a31 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:31.785630 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b982319d-e2e1-4969-983a-5a6dae5f3a31 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:31.907325 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b982319d-e2e1-4969-983a-5a6dae5f3a31 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:31.915298 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b982319d-e2e1-4969-983a-5a6dae5f3a31 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 200 len: 1265 microversion: 2.1 time: 0.142593 Oct 28 12:23:31.915851 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 668/1357] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:31 2021] GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:32.073194 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d55684db-570e-48fe-9947-f250c7258d01 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:32.074089 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d55684db-570e-48fe-9947-f250c7258d01 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:32.081380 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d55684db-570e-48fe-9947-f250c7258d01 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:32.081818 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d55684db-570e-48fe-9947-f250c7258d01 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:32.082572 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d55684db-570e-48fe-9947-f250c7258d01 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:32.083027 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d55684db-570e-48fe-9947-f250c7258d01 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:32.146830 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d55684db-570e-48fe-9947-f250c7258d01 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 14 microversion: 2.1 time: 0.077658 Oct 28 12:23:32.147413 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 690/1358] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:32 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:23:32.932038 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f8bdc826-e91d-4417-b4eb-ca0092226aae tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:32.932647 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f8bdc826-e91d-4417-b4eb-ca0092226aae tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:32.938899 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f8bdc826-e91d-4417-b4eb-ca0092226aae tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:32.939358 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f8bdc826-e91d-4417-b4eb-ca0092226aae tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:32.940128 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f8bdc826-e91d-4417-b4eb-ca0092226aae tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:32.940554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f8bdc826-e91d-4417-b4eb-ca0092226aae tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:33.058788 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f8bdc826-e91d-4417-b4eb-ca0092226aae tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:33.065920 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f8bdc826-e91d-4417-b4eb-ca0092226aae tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 200 len: 1265 microversion: 2.1 time: 0.137527 Oct 28 12:23:33.066589 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 669/1359] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:32 2021] GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:33.158673 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a4ee135d-744a-4acb-8a94-4331916db85a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:33.159697 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a4ee135d-744a-4acb-8a94-4331916db85a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:33.166521 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a4ee135d-744a-4acb-8a94-4331916db85a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:33.167004 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a4ee135d-744a-4acb-8a94-4331916db85a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:33.168029 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a4ee135d-744a-4acb-8a94-4331916db85a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:33.168459 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a4ee135d-744a-4acb-8a94-4331916db85a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:33.224824 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a4ee135d-744a-4acb-8a94-4331916db85a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 14 microversion: 2.1 time: 0.070573 Oct 28 12:23:33.225423 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 691/1360] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:33 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:23:34.082897 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-355da086-41ca-4918-bd61-8a86c5831cf1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:34.083424 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-355da086-41ca-4918-bd61-8a86c5831cf1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:34.089623 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-355da086-41ca-4918-bd61-8a86c5831cf1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:34.090063 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-355da086-41ca-4918-bd61-8a86c5831cf1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:34.090852 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-355da086-41ca-4918-bd61-8a86c5831cf1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:34.091281 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-355da086-41ca-4918-bd61-8a86c5831cf1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:34.208498 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-355da086-41ca-4918-bd61-8a86c5831cf1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:34.215704 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-355da086-41ca-4918-bd61-8a86c5831cf1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 200 len: 1265 microversion: 2.1 time: 0.137118 Oct 28 12:23:34.216265 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 670/1361] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:34 2021] GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:34.236001 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fd7ea9b5-aebf-4112-884a-cbd2472562f5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:34.236979 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fd7ea9b5-aebf-4112-884a-cbd2472562f5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:34.243738 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd7ea9b5-aebf-4112-884a-cbd2472562f5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:34.244174 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd7ea9b5-aebf-4112-884a-cbd2472562f5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:34.244933 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd7ea9b5-aebf-4112-884a-cbd2472562f5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:34.245355 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fd7ea9b5-aebf-4112-884a-cbd2472562f5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:34.302788 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fd7ea9b5-aebf-4112-884a-cbd2472562f5 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 14 microversion: 2.1 time: 0.070558 Oct 28 12:23:34.303407 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 692/1362] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:34 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:23:35.233042 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-406cb56b-90ff-47d2-a536-b9ab9ed76170 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:35.233666 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-406cb56b-90ff-47d2-a536-b9ab9ed76170 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:35.240593 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-406cb56b-90ff-47d2-a536-b9ab9ed76170 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:35.241039 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-406cb56b-90ff-47d2-a536-b9ab9ed76170 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:35.241807 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-406cb56b-90ff-47d2-a536-b9ab9ed76170 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:35.242241 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-406cb56b-90ff-47d2-a536-b9ab9ed76170 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:35.313870 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2a6bd036-5a18-4eb5-add3-db1eae1af590 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:35.314901 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2a6bd036-5a18-4eb5-add3-db1eae1af590 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:35.321730 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2a6bd036-5a18-4eb5-add3-db1eae1af590 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:35.322176 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2a6bd036-5a18-4eb5-add3-db1eae1af590 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:35.323187 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2a6bd036-5a18-4eb5-add3-db1eae1af590 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:35.323615 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2a6bd036-5a18-4eb5-add3-db1eae1af590 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:35.365757 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-406cb56b-90ff-47d2-a536-b9ab9ed76170 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:35.373006 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-406cb56b-90ff-47d2-a536-b9ab9ed76170 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 200 len: 1265 microversion: 2.1 time: 0.143764 Oct 28 12:23:35.373572 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 671/1363] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:35 2021] GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:35.404171 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2a6bd036-5a18-4eb5-add3-db1eae1af590 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 9379 microversion: 2.1 time: 0.094176 Oct 28 12:23:35.404832 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 693/1364] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:35 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 9379 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:23:36.389281 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5d56e91c-ad10-4b4f-9da8-08383fc168d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:36.389875 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5d56e91c-ad10-4b4f-9da8-08383fc168d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:36.396504 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d56e91c-ad10-4b4f-9da8-08383fc168d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:36.396945 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d56e91c-ad10-4b4f-9da8-08383fc168d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:36.397848 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d56e91c-ad10-4b4f-9da8-08383fc168d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:36.398273 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d56e91c-ad10-4b4f-9da8-08383fc168d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:36.416257 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5f341058-bb41-4f9e-958e-dcaa135ba9ff tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:36.417246 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5f341058-bb41-4f9e-958e-dcaa135ba9ff tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:36.424904 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5f341058-bb41-4f9e-958e-dcaa135ba9ff tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:36.425347 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5f341058-bb41-4f9e-958e-dcaa135ba9ff tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:36.426112 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5f341058-bb41-4f9e-958e-dcaa135ba9ff tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:36.426538 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5f341058-bb41-4f9e-958e-dcaa135ba9ff tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:36.498780 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5f341058-bb41-4f9e-958e-dcaa135ba9ff tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 16196 microversion: 2.1 time: 0.086281 Oct 28 12:23:36.503279 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 694/1365] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:36 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 16196 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:23:36.519560 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5d56e91c-ad10-4b4f-9da8-08383fc168d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:36.526810 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5d56e91c-ad10-4b4f-9da8-08383fc168d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 200 len: 1265 microversion: 2.1 time: 0.141127 Oct 28 12:23:36.527374 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 672/1366] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:36 2021] GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:37.510538 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-385c9f21-e1e3-4849-a2da-7380f153ddec tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:37.511566 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-385c9f21-e1e3-4849-a2da-7380f153ddec tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:37.519031 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-385c9f21-e1e3-4849-a2da-7380f153ddec tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:37.519480 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-385c9f21-e1e3-4849-a2da-7380f153ddec tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:37.520247 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-385c9f21-e1e3-4849-a2da-7380f153ddec tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:37.520680 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-385c9f21-e1e3-4849-a2da-7380f153ddec tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:37.542354 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-18506640-2a8b-46d8-9643-720ae20f8c6a tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:37.543235 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-18506640-2a8b-46d8-9643-720ae20f8c6a tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:37.549496 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18506640-2a8b-46d8-9643-720ae20f8c6a tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:37.549940 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18506640-2a8b-46d8-9643-720ae20f8c6a tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:37.550804 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18506640-2a8b-46d8-9643-720ae20f8c6a tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:37.551240 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18506640-2a8b-46d8-9643-720ae20f8c6a tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:37.598278 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-385c9f21-e1e3-4849-a2da-7380f153ddec tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 18398 microversion: 2.1 time: 0.091605 Oct 28 12:23:37.599328 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 695/1367] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:37 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 18398 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:37.670142 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-18506640-2a8b-46d8-9643-720ae20f8c6a tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:37.677316 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-18506640-2a8b-46d8-9643-720ae20f8c6a tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 200 len: 1265 microversion: 2.1 time: 0.138643 Oct 28 12:23:37.677879 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 673/1368] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:37 2021] GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:23:38.609844 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-944bd165-146a-46ff-bd95-2a832b1811c4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:38.610783 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-944bd165-146a-46ff-bd95-2a832b1811c4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:38.617696 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-944bd165-146a-46ff-bd95-2a832b1811c4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:38.618146 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-944bd165-146a-46ff-bd95-2a832b1811c4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:38.618940 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-944bd165-146a-46ff-bd95-2a832b1811c4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:38.619372 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-944bd165-146a-46ff-bd95-2a832b1811c4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:38.693042 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-533aca76-5670-4728-ab52-a3c2e80dabe1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:38.693805 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-533aca76-5670-4728-ab52-a3c2e80dabe1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:38.697708 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-944bd165-146a-46ff-bd95-2a832b1811c4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 20757 microversion: 2.1 time: 0.091737 Oct 28 12:23:38.698728 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 696/1369] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:38 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 20757 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:38.702634 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-533aca76-5670-4728-ab52-a3c2e80dabe1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:38.703123 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-533aca76-5670-4728-ab52-a3c2e80dabe1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:38.704427 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-533aca76-5670-4728-ab52-a3c2e80dabe1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:38.704874 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-533aca76-5670-4728-ab52-a3c2e80dabe1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:38.828146 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-533aca76-5670-4728-ab52-a3c2e80dabe1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:38.836236 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-533aca76-5670-4728-ab52-a3c2e80dabe1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 200 len: 1265 microversion: 2.1 time: 0.146761 Oct 28 12:23:38.836816 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 674/1370] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:38 2021] GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:23:39.710250 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2aa3d6c7-2c87-4180-977d-05c3d5d1114b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:39.711258 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2aa3d6c7-2c87-4180-977d-05c3d5d1114b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:39.718129 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2aa3d6c7-2c87-4180-977d-05c3d5d1114b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:39.718580 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2aa3d6c7-2c87-4180-977d-05c3d5d1114b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:39.719366 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2aa3d6c7-2c87-4180-977d-05c3d5d1114b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:39.720300 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2aa3d6c7-2c87-4180-977d-05c3d5d1114b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:39.788538 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2aa3d6c7-2c87-4180-977d-05c3d5d1114b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 22846 microversion: 2.1 time: 0.082231 Oct 28 12:23:39.789383 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 697/1371] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:39 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 22846 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:23:39.853041 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-68bca5af-e08d-4e27-93df-222e50ac4d85 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:39.853633 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-68bca5af-e08d-4e27-93df-222e50ac4d85 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:39.859905 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-68bca5af-e08d-4e27-93df-222e50ac4d85 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:39.860988 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-68bca5af-e08d-4e27-93df-222e50ac4d85 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:39.861757 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-68bca5af-e08d-4e27-93df-222e50ac4d85 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:39.862184 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-68bca5af-e08d-4e27-93df-222e50ac4d85 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:39.980979 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-68bca5af-e08d-4e27-93df-222e50ac4d85 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:39.988855 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-68bca5af-e08d-4e27-93df-222e50ac4d85 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 200 len: 1265 microversion: 2.1 time: 0.139554 Oct 28 12:23:39.989424 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 675/1372] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:39 2021] GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:40.468205 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-308ca31e-7f8f-455e-9364-d615a91bf549 req-cc6dc223-2d71-4459-98c0-9f153dfafa72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4023905f-5420-4e27-99bd-a9465bb7c9ac", "name": "network-vif-plugged", "status": "completed", "tag": "27692bcf-cac2-47f5-bc7e-a77918b203e2"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:40.469696 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:23:40.469696 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:23:40.477673 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-308ca31e-7f8f-455e-9364-d615a91bf549 req-cc6dc223-2d71-4459-98c0-9f153dfafa72 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:40.478111 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-308ca31e-7f8f-455e-9364-d615a91bf549 req-cc6dc223-2d71-4459-98c0-9f153dfafa72 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:40.489570 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-308ca31e-7f8f-455e-9364-d615a91bf549 req-cc6dc223-2d71-4459-98c0-9f153dfafa72 service nova] Creating event network-vif-plugged:27692bcf-cac2-47f5-bc7e-a77918b203e2 for instance 4023905f-5420-4e27-99bd-a9465bb7c9ac on hv-cinder-81571 Oct 28 12:23:40.494425 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-308ca31e-7f8f-455e-9364-d615a91bf549 req-cc6dc223-2d71-4459-98c0-9f153dfafa72 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030192 Oct 28 12:23:40.495101 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 698/1373] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:23:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:23:40.800285 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b454751a-8b2c-40fd-a8f8-e4b8d3da4c00 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:40.801227 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b454751a-8b2c-40fd-a8f8-e4b8d3da4c00 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:40.807020 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b454751a-8b2c-40fd-a8f8-e4b8d3da4c00 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:40.807465 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b454751a-8b2c-40fd-a8f8-e4b8d3da4c00 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:40.808228 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b454751a-8b2c-40fd-a8f8-e4b8d3da4c00 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:40.808657 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b454751a-8b2c-40fd-a8f8-e4b8d3da4c00 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:41.006765 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d1b9ea6e-9680-4dcf-81ac-0b728b9a128d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:41.007387 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d1b9ea6e-9680-4dcf-81ac-0b728b9a128d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:41.013480 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d1b9ea6e-9680-4dcf-81ac-0b728b9a128d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:41.013930 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d1b9ea6e-9680-4dcf-81ac-0b728b9a128d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:41.014753 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d1b9ea6e-9680-4dcf-81ac-0b728b9a128d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:41.015188 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d1b9ea6e-9680-4dcf-81ac-0b728b9a128d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:41.068533 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b454751a-8b2c-40fd-a8f8-e4b8d3da4c00 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 24041 microversion: 2.1 time: 0.272167 Oct 28 12:23:41.069609 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 676/1374] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:40 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 24041 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:41.135494 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d1b9ea6e-9680-4dcf-81ac-0b728b9a128d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:41.142640 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d1b9ea6e-9680-4dcf-81ac-0b728b9a128d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 200 len: 1265 microversion: 2.1 time: 0.140392 Oct 28 12:23:41.143228 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 699/1375] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:41 2021] GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:23:42.080894 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c45bb2c7-7812-4b23-963e-97fb8738ace8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:42.081911 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c45bb2c7-7812-4b23-963e-97fb8738ace8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:42.088724 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c45bb2c7-7812-4b23-963e-97fb8738ace8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:42.089166 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c45bb2c7-7812-4b23-963e-97fb8738ace8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:42.089961 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c45bb2c7-7812-4b23-963e-97fb8738ace8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:42.090390 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c45bb2c7-7812-4b23-963e-97fb8738ace8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:42.159150 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6c14c05e-e59f-4bbf-9e20-656d0b3267d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:42.159756 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6c14c05e-e59f-4bbf-9e20-656d0b3267d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:42.167633 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6c14c05e-e59f-4bbf-9e20-656d0b3267d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:42.168076 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6c14c05e-e59f-4bbf-9e20-656d0b3267d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:42.168837 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6c14c05e-e59f-4bbf-9e20-656d0b3267d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:42.169260 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6c14c05e-e59f-4bbf-9e20-656d0b3267d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:42.182156 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c45bb2c7-7812-4b23-963e-97fb8738ace8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 25469 microversion: 2.1 time: 0.105748 Oct 28 12:23:42.186077 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 677/1376] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:42 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 25469 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:23:42.288845 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6c14c05e-e59f-4bbf-9e20-656d0b3267d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:42.296404 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6c14c05e-e59f-4bbf-9e20-656d0b3267d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 200 len: 1452 microversion: 2.1 time: 0.140879 Oct 28 12:23:42.296967 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 700/1377] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:42 2021] GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 1452 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:23:42.313040 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b96be21c-5c21-48a1-ac0c-9c95678280d5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:42.314371 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b96be21c-5c21-48a1-ac0c-9c95678280d5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:42.321173 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b96be21c-5c21-48a1-ac0c-9c95678280d5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:42.321618 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b96be21c-5c21-48a1-ac0c-9c95678280d5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:42.322391 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b96be21c-5c21-48a1-ac0c-9c95678280d5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:42.322854 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b96be21c-5c21-48a1-ac0c-9c95678280d5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:42.440581 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-b96be21c-5c21-48a1-ac0c-9c95678280d5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:42.447823 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b96be21c-5c21-48a1-ac0c-9c95678280d5 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 200 len: 1452 microversion: 2.1 time: 0.138774 Oct 28 12:23:42.448397 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 678/1378] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:23:42 2021] GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 1452 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:43.193797 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-02f8ee29-e363-48aa-9a20-702e7af41cda tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:43.194789 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-02f8ee29-e363-48aa-9a20-702e7af41cda tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:43.201107 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-02f8ee29-e363-48aa-9a20-702e7af41cda tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:43.201562 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-02f8ee29-e363-48aa-9a20-702e7af41cda tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:43.202328 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-02f8ee29-e363-48aa-9a20-702e7af41cda tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:43.202800 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-02f8ee29-e363-48aa-9a20-702e7af41cda tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:43.284866 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-02f8ee29-e363-48aa-9a20-702e7af41cda tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 26810 microversion: 2.1 time: 0.094679 Oct 28 12:23:43.285734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 701/1379] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:43 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 26810 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:44.278539 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-389bb81a-5e73-4c54-a8f5-c78dfebb79d4 req-7483f7ac-dad0-4229-a333-a618b5144652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4023905f-5420-4e27-99bd-a9465bb7c9ac", "tag": "27692bcf-cac2-47f5-bc7e-a77918b203e2"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:44.280143 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:23:44.280143 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:23:44.288148 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-389bb81a-5e73-4c54-a8f5-c78dfebb79d4 req-7483f7ac-dad0-4229-a333-a618b5144652 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:44.288589 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-389bb81a-5e73-4c54-a8f5-c78dfebb79d4 req-7483f7ac-dad0-4229-a333-a618b5144652 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:44.298328 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d91da25b-6842-4208-b7fb-3ee425f65aa4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:44.300120 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d91da25b-6842-4208-b7fb-3ee425f65aa4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:44.302006 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-389bb81a-5e73-4c54-a8f5-c78dfebb79d4 req-7483f7ac-dad0-4229-a333-a618b5144652 service nova] Creating event network-changed:27692bcf-cac2-47f5-bc7e-a77918b203e2 for instance 4023905f-5420-4e27-99bd-a9465bb7c9ac on hv-cinder-81571 Oct 28 12:23:44.307765 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d91da25b-6842-4208-b7fb-3ee425f65aa4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:44.308213 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d91da25b-6842-4208-b7fb-3ee425f65aa4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:44.308592 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-389bb81a-5e73-4c54-a8f5-c78dfebb79d4 req-7483f7ac-dad0-4229-a333-a618b5144652 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034140 Oct 28 12:23:44.308999 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d91da25b-6842-4208-b7fb-3ee425f65aa4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:44.309320 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 679/1380] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:23:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:23:44.309458 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d91da25b-6842-4208-b7fb-3ee425f65aa4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:44.392518 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d91da25b-6842-4208-b7fb-3ee425f65aa4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 27675 microversion: 2.1 time: 0.098747 Oct 28 12:23:44.396630 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 702/1381] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:44 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 27675 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:45.405152 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-54c29fe5-3c2a-4220-9827-e50df78d4db9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:45.406243 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-54c29fe5-3c2a-4220-9827-e50df78d4db9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:45.413178 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54c29fe5-3c2a-4220-9827-e50df78d4db9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:45.413575 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54c29fe5-3c2a-4220-9827-e50df78d4db9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:45.414331 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54c29fe5-3c2a-4220-9827-e50df78d4db9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:45.414790 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-54c29fe5-3c2a-4220-9827-e50df78d4db9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:45.493731 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-54c29fe5-3c2a-4220-9827-e50df78d4db9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28176 microversion: 2.1 time: 0.092947 Oct 28 12:23:45.494399 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 680/1382] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:45 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28176 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:46.505789 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-05b5a095-025a-4670-a052-de5565063475 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:46.506956 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-05b5a095-025a-4670-a052-de5565063475 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:46.513658 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-05b5a095-025a-4670-a052-de5565063475 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:46.514101 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-05b5a095-025a-4670-a052-de5565063475 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:46.514886 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-05b5a095-025a-4670-a052-de5565063475 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:46.515314 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-05b5a095-025a-4670-a052-de5565063475 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:46.594098 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-05b5a095-025a-4670-a052-de5565063475 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28221 microversion: 2.1 time: 0.092072 Oct 28 12:23:46.595187 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 703/1383] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:46 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:47.605872 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-58e336bb-1c7b-4ef8-9327-1dd2557b7488 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:47.606827 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-58e336bb-1c7b-4ef8-9327-1dd2557b7488 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:47.613484 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-58e336bb-1c7b-4ef8-9327-1dd2557b7488 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:47.613920 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-58e336bb-1c7b-4ef8-9327-1dd2557b7488 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:47.614672 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-58e336bb-1c7b-4ef8-9327-1dd2557b7488 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:47.615119 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-58e336bb-1c7b-4ef8-9327-1dd2557b7488 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:47.675694 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-58e336bb-1c7b-4ef8-9327-1dd2557b7488 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28221 microversion: 2.1 time: 0.073746 Oct 28 12:23:47.676325 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 681/1384] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:47 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28221 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:23:48.687963 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-cbaa7de4-c37e-41df-9d59-3f75a75178fa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:48.688956 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-cbaa7de4-c37e-41df-9d59-3f75a75178fa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:48.696331 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cbaa7de4-c37e-41df-9d59-3f75a75178fa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:48.696779 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cbaa7de4-c37e-41df-9d59-3f75a75178fa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:48.697561 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cbaa7de4-c37e-41df-9d59-3f75a75178fa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:48.698027 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-cbaa7de4-c37e-41df-9d59-3f75a75178fa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:48.766076 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-cbaa7de4-c37e-41df-9d59-3f75a75178fa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28221 microversion: 2.1 time: 0.081980 Oct 28 12:23:48.766967 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 704/1385] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:48 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28221 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:49.778034 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1c05c32c-95f9-4540-bd05-d1487922778e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:49.779046 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1c05c32c-95f9-4540-bd05-d1487922778e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:49.785717 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1c05c32c-95f9-4540-bd05-d1487922778e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:49.786151 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1c05c32c-95f9-4540-bd05-d1487922778e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:49.786936 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1c05c32c-95f9-4540-bd05-d1487922778e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:49.787378 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1c05c32c-95f9-4540-bd05-d1487922778e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:49.848372 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1c05c32c-95f9-4540-bd05-d1487922778e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28221 microversion: 2.1 time: 0.074160 Oct 28 12:23:49.849279 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 682/1386] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:49 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28221 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:50.860416 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5175d0d8-d12d-4e36-8af8-6a55ba871149 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:50.861433 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5175d0d8-d12d-4e36-8af8-6a55ba871149 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:50.868396 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5175d0d8-d12d-4e36-8af8-6a55ba871149 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:50.868841 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5175d0d8-d12d-4e36-8af8-6a55ba871149 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:50.869617 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5175d0d8-d12d-4e36-8af8-6a55ba871149 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:50.870051 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5175d0d8-d12d-4e36-8af8-6a55ba871149 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:50.933180 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5175d0d8-d12d-4e36-8af8-6a55ba871149 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28221 microversion: 2.1 time: 0.076750 Oct 28 12:23:50.933801 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 705/1387] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:50 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:51.945240 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-038c3160-6511-41de-8e15-535134f45325 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:51.946215 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-038c3160-6511-41de-8e15-535134f45325 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:51.953251 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-038c3160-6511-41de-8e15-535134f45325 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:51.953698 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-038c3160-6511-41de-8e15-535134f45325 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:51.954471 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-038c3160-6511-41de-8e15-535134f45325 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:51.954930 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-038c3160-6511-41de-8e15-535134f45325 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:52.029784 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-038c3160-6511-41de-8e15-535134f45325 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28221 microversion: 2.1 time: 0.088493 Oct 28 12:23:52.030489 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 683/1388] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:51 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:53.042726 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ab95a345-6f10-4bce-9279-0c8f180db854 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:53.043642 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ab95a345-6f10-4bce-9279-0c8f180db854 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:53.051184 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ab95a345-6f10-4bce-9279-0c8f180db854 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:53.051686 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ab95a345-6f10-4bce-9279-0c8f180db854 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:53.052459 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ab95a345-6f10-4bce-9279-0c8f180db854 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:53.052897 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ab95a345-6f10-4bce-9279-0c8f180db854 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:53.115734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ab95a345-6f10-4bce-9279-0c8f180db854 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28221 microversion: 2.1 time: 0.077278 Oct 28 12:23:53.116390 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 706/1389] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:53 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:54.127943 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3cd26483-3ab5-44d5-850a-226d7293dd49 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:54.129066 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3cd26483-3ab5-44d5-850a-226d7293dd49 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:54.135881 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3cd26483-3ab5-44d5-850a-226d7293dd49 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:54.136328 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3cd26483-3ab5-44d5-850a-226d7293dd49 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:54.137097 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3cd26483-3ab5-44d5-850a-226d7293dd49 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:54.137537 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3cd26483-3ab5-44d5-850a-226d7293dd49 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:54.203111 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3cd26483-3ab5-44d5-850a-226d7293dd49 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28221 microversion: 2.1 time: 0.079113 Oct 28 12:23:54.204017 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 684/1390] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:54 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:55.215517 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-41cd1360-7202-432c-bd0d-acc060e31657 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:55.216510 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-41cd1360-7202-432c-bd0d-acc060e31657 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:55.224067 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-41cd1360-7202-432c-bd0d-acc060e31657 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:55.224512 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-41cd1360-7202-432c-bd0d-acc060e31657 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:55.225284 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-41cd1360-7202-432c-bd0d-acc060e31657 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:55.225711 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-41cd1360-7202-432c-bd0d-acc060e31657 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:55.286308 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-41cd1360-7202-432c-bd0d-acc060e31657 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28221 microversion: 2.1 time: 0.074698 Oct 28 12:23:55.287200 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 707/1391] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:55 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28221 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:56.299311 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-cce81fc8-f3e7-4724-b36e-216e9b840dcb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:56.300345 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-cce81fc8-f3e7-4724-b36e-216e9b840dcb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:56.307139 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cce81fc8-f3e7-4724-b36e-216e9b840dcb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:56.307582 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cce81fc8-f3e7-4724-b36e-216e9b840dcb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:56.308341 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cce81fc8-f3e7-4724-b36e-216e9b840dcb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:56.308772 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-cce81fc8-f3e7-4724-b36e-216e9b840dcb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:56.369803 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-cce81fc8-f3e7-4724-b36e-216e9b840dcb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28221 microversion: 2.1 time: 0.075025 Oct 28 12:23:56.370723 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 685/1392] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:56 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28221 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:57.382327 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c9d50942-4e51-4c49-8072-70d4cfcbce0b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:57.383330 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c9d50942-4e51-4c49-8072-70d4cfcbce0b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:57.390049 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c9d50942-4e51-4c49-8072-70d4cfcbce0b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:57.390490 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c9d50942-4e51-4c49-8072-70d4cfcbce0b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:57.391271 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c9d50942-4e51-4c49-8072-70d4cfcbce0b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:57.391693 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c9d50942-4e51-4c49-8072-70d4cfcbce0b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:57.473721 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c9d50942-4e51-4c49-8072-70d4cfcbce0b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28221 microversion: 2.1 time: 0.095214 Oct 28 12:23:57.474297 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 708/1393] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:57 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28221 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:58.486300 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5c18c20c-461b-4fa7-a00e-91e2e134defa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:58.487329 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5c18c20c-461b-4fa7-a00e-91e2e134defa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:58.494099 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5c18c20c-461b-4fa7-a00e-91e2e134defa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:58.494542 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5c18c20c-461b-4fa7-a00e-91e2e134defa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:58.495332 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5c18c20c-461b-4fa7-a00e-91e2e134defa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:58.495764 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5c18c20c-461b-4fa7-a00e-91e2e134defa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:58.583097 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5c18c20c-461b-4fa7-a00e-91e2e134defa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28416 microversion: 2.1 time: 0.101287 Oct 28 12:23:58.583997 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 686/1394] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:58 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28416 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:23:58.934691 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-adf5f85f-df97-4177-8e5e-4722a2010002 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:58.935834 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-adf5f85f-df97-4177-8e5e-4722a2010002 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:58.942942 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-adf5f85f-df97-4177-8e5e-4722a2010002 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:58.943389 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-adf5f85f-df97-4177-8e5e-4722a2010002 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:58.944159 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-adf5f85f-df97-4177-8e5e-4722a2010002 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:58.944590 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-adf5f85f-df97-4177-8e5e-4722a2010002 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:58.974455 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-adf5f85f-df97-4177-8e5e-4722a2010002 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043934 Oct 28 12:23:58.975035 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 709/1395] 10.222.0.37 () {60 vars in 1342 bytes} [Thu Oct 28 12:23:58 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:23:59.030027 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-dd1940c7-2705-4fa1-9b4f-76867c3e9dca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:59.030631 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-dd1940c7-2705-4fa1-9b4f-76867c3e9dca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:59.038129 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd1940c7-2705-4fa1-9b4f-76867c3e9dca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:59.038573 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd1940c7-2705-4fa1-9b4f-76867c3e9dca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:59.039361 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd1940c7-2705-4fa1-9b4f-76867c3e9dca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:59.039787 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dd1940c7-2705-4fa1-9b4f-76867c3e9dca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:59.063664 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-dd1940c7-2705-4fa1-9b4f-76867c3e9dca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:23:59.134837 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-dd1940c7-2705-4fa1-9b4f-76867c3e9dca tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "DELETE /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 204 len: 0 microversion: 2.20 time: 0.108569 Oct 28 12:23:59.135418 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 687/1396] 10.222.0.37 () {60 vars in 1279 bytes} [Thu Oct 28 12:23:59 2021] DELETE /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 12:23:59.143898 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-784adf02-bae2-4091-a1c5-183404f38a1a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:23:59.144501 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-784adf02-bae2-4091-a1c5-183404f38a1a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:59.151830 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-784adf02-bae2-4091-a1c5-183404f38a1a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:59.152287 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-784adf02-bae2-4091-a1c5-183404f38a1a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:59.153071 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-784adf02-bae2-4091-a1c5-183404f38a1a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:59.153508 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-784adf02-bae2-4091-a1c5-183404f38a1a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:59.278593 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-784adf02-bae2-4091-a1c5-183404f38a1a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:59.289130 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-784adf02-bae2-4091-a1c5-183404f38a1a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:59.290647 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-784adf02-bae2-4091-a1c5-183404f38a1a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:23:59.291849 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-784adf02-bae2-4091-a1c5-183404f38a1a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1720 microversion: 2.20 time: 0.152246 Oct 28 12:23:59.292671 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 710/1397] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:23:59 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:23:59.595132 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-99463359-616c-4ac7-8d5d-32ac6b3fa1fe tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:23:59.596047 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-99463359-616c-4ac7-8d5d-32ac6b3fa1fe tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:23:59.602366 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-99463359-616c-4ac7-8d5d-32ac6b3fa1fe tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:59.602855 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-99463359-616c-4ac7-8d5d-32ac6b3fa1fe tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:59.603624 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-99463359-616c-4ac7-8d5d-32ac6b3fa1fe tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:23:59.604051 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-99463359-616c-4ac7-8d5d-32ac6b3fa1fe tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:23:59.683951 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-99463359-616c-4ac7-8d5d-32ac6b3fa1fe tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28512 microversion: 2.1 time: 0.092784 Oct 28 12:23:59.684842 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 688/1398] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:23:59 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28512 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:00.310021 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-01ba74c7-5f90-45a7-8771-7f469c7bc060 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:00.310703 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-01ba74c7-5f90-45a7-8771-7f469c7bc060 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:00.317006 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-01ba74c7-5f90-45a7-8771-7f469c7bc060 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:00.317451 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-01ba74c7-5f90-45a7-8771-7f469c7bc060 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:00.318212 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-01ba74c7-5f90-45a7-8771-7f469c7bc060 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:00.318739 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-01ba74c7-5f90-45a7-8771-7f469c7bc060 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:00.436231 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-01ba74c7-5f90-45a7-8771-7f469c7bc060 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:24:00.443852 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-01ba74c7-5f90-45a7-8771-7f469c7bc060 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:24:00.445341 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-01ba74c7-5f90-45a7-8771-7f469c7bc060 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:24:00.446485 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-01ba74c7-5f90-45a7-8771-7f469c7bc060 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1720 microversion: 2.20 time: 0.140175 Oct 28 12:24:00.447072 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 711/1399] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:24:00 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1720 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:24:00.696265 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-eaca6f24-32bb-4e2e-9e3f-93675338e81a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:00.697256 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-eaca6f24-32bb-4e2e-9e3f-93675338e81a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:00.704045 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-eaca6f24-32bb-4e2e-9e3f-93675338e81a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:00.705104 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-eaca6f24-32bb-4e2e-9e3f-93675338e81a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:00.705867 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-eaca6f24-32bb-4e2e-9e3f-93675338e81a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:00.706306 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-eaca6f24-32bb-4e2e-9e3f-93675338e81a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:00.823425 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-eaca6f24-32bb-4e2e-9e3f-93675338e81a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.130980 Oct 28 12:24:00.824329 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 689/1400] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:00 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:01.464879 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b75b0b40-b961-471c-ae5c-123a7e030d27 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:01.465493 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b75b0b40-b961-471c-ae5c-123a7e030d27 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:01.472221 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b75b0b40-b961-471c-ae5c-123a7e030d27 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:01.473083 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b75b0b40-b961-471c-ae5c-123a7e030d27 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:01.473428 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b75b0b40-b961-471c-ae5c-123a7e030d27 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:01.473860 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b75b0b40-b961-471c-ae5c-123a7e030d27 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:01.571908 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b75b0b40-b961-471c-ae5c-123a7e030d27 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:24:01.579498 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b75b0b40-b961-471c-ae5c-123a7e030d27 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:24:01.581038 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b75b0b40-b961-471c-ae5c-123a7e030d27 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8df0567fb17c4b159e7bf0df45012f84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8919258b85146488d50b07efbad50ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:24:01.582201 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b75b0b40-b961-471c-ae5c-123a7e030d27 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 200 len: 1653 microversion: 2.20 time: 0.121039 Oct 28 12:24:01.582784 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 712/1401] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:24:01 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 1653 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:24:01.676808 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-f115dcf4-ff19-42a4-a371-4bc8926e6a90 req-77c3b6c7-4e4a-4552-9e01-f361dd061844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19635150-a15f-4d59-a3a3-adc15a411e40", "name": "network-vif-deleted", "tag": "df78786b-91a7-4ab8-9ff2-b69bbf31776f"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:01.679424 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:24:01.679424 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:24:01.689104 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-f115dcf4-ff19-42a4-a371-4bc8926e6a90 req-77c3b6c7-4e4a-4552-9e01-f361dd061844 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:01.689545 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-f115dcf4-ff19-42a4-a371-4bc8926e6a90 req-77c3b6c7-4e4a-4552-9e01-f361dd061844 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:01.708941 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-f115dcf4-ff19-42a4-a371-4bc8926e6a90 req-77c3b6c7-4e4a-4552-9e01-f361dd061844 service nova] Creating event network-vif-deleted:df78786b-91a7-4ab8-9ff2-b69bbf31776f for instance 19635150-a15f-4d59-a3a3-adc15a411e40 on hv-cinder-81571 Oct 28 12:24:01.715974 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-f115dcf4-ff19-42a4-a371-4bc8926e6a90 req-77c3b6c7-4e4a-4552-9e01-f361dd061844 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044150 Oct 28 12:24:01.716830 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 690/1402] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:24:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:01.835879 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b5bcba1f-2f08-40da-83c8-88e635a95b31 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:01.836706 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b5bcba1f-2f08-40da-83c8-88e635a95b31 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:01.842791 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b5bcba1f-2f08-40da-83c8-88e635a95b31 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:01.843250 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b5bcba1f-2f08-40da-83c8-88e635a95b31 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:01.844096 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b5bcba1f-2f08-40da-83c8-88e635a95b31 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:01.844527 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b5bcba1f-2f08-40da-83c8-88e635a95b31 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:01.914554 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b5bcba1f-2f08-40da-83c8-88e635a95b31 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.082332 Oct 28 12:24:01.915488 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 713/1403] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:01 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:24:02.604830 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8f82b913-bc69-4e98-a329-93e8a0d40378 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:02.605477 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8f82b913-bc69-4e98-a329-93e8a0d40378 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:02.612397 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f82b913-bc69-4e98-a329-93e8a0d40378 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:02.612840 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f82b913-bc69-4e98-a329-93e8a0d40378 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:02.613606 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f82b913-bc69-4e98-a329-93e8a0d40378 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:02.614040 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8f82b913-bc69-4e98-a329-93e8a0d40378 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:02.628347 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-8f82b913-bc69-4e98-a329-93e8a0d40378 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] HTTP exception thrown: Instance 19635150-a15f-4d59-a3a3-adc15a411e40 could not be found. Oct 28 12:24:02.628940 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8f82b913-bc69-4e98-a329-93e8a0d40378 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Returning 404 to user: Instance 19635150-a15f-4d59-a3a3-adc15a411e40 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:24:02.630240 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8f82b913-bc69-4e98-a329-93e8a0d40378 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 404 len: 111 microversion: 2.20 time: 0.029069 Oct 28 12:24:02.633775 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 691/1404] 10.222.0.37 () {60 vars in 1276 bytes} [Thu Oct 28 12:24:02 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 12:24:02.640344 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-0589e9a2-1304-468c-b318-10f524649bde tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '.version_select at 0x7f11f809a700>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:02.658529 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-0589e9a2-1304-468c-b318-10f524649bde tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-38731555" status: 204 len: 0 microversion: 2.20 time: 0.023152 Oct 28 12:24:02.659731 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 714/1405] 10.222.0.37 () {60 vars in 1255 bytes} [Thu Oct 28 12:24:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-38731555 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 12:24:02.927382 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6ffb98dd-82ad-4497-82bb-51250d15c367 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:02.928295 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6ffb98dd-82ad-4497-82bb-51250d15c367 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:02.934548 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6ffb98dd-82ad-4497-82bb-51250d15c367 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:02.935040 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6ffb98dd-82ad-4497-82bb-51250d15c367 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:02.935811 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6ffb98dd-82ad-4497-82bb-51250d15c367 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:02.936241 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6ffb98dd-82ad-4497-82bb-51250d15c367 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:02.997411 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6ffb98dd-82ad-4497-82bb-51250d15c367 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.073884 Oct 28 12:24:02.999860 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 692/1406] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:02 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:04.009947 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ac8c9cd9-303b-435d-8cec-6cd85254d4d1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:04.010972 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ac8c9cd9-303b-435d-8cec-6cd85254d4d1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:04.018285 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ac8c9cd9-303b-435d-8cec-6cd85254d4d1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:04.018752 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ac8c9cd9-303b-435d-8cec-6cd85254d4d1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:04.019515 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ac8c9cd9-303b-435d-8cec-6cd85254d4d1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:04.019938 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ac8c9cd9-303b-435d-8cec-6cd85254d4d1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:04.078814 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ac8c9cd9-303b-435d-8cec-6cd85254d4d1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.072901 Oct 28 12:24:04.079946 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 715/1407] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:04 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:24:04.427042 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bfe12844-064e-495a-b65d-93358c35f8dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:04.427625 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bfe12844-064e-495a-b65d-93358c35f8dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:04.434335 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bfe12844-064e-495a-b65d-93358c35f8dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:04.434820 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bfe12844-064e-495a-b65d-93358c35f8dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:04.435587 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bfe12844-064e-495a-b65d-93358c35f8dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:04.436017 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bfe12844-064e-495a-b65d-93358c35f8dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:04.450016 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-bfe12844-064e-495a-b65d-93358c35f8dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] HTTP exception thrown: Instance 19635150-a15f-4d59-a3a3-adc15a411e40 could not be found. Oct 28 12:24:04.450599 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bfe12844-064e-495a-b65d-93358c35f8dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Returning 404 to user: Instance 19635150-a15f-4d59-a3a3-adc15a411e40 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:24:04.451448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bfe12844-064e-495a-b65d-93358c35f8dc tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "DELETE /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 404 len: 111 microversion: 2.1 time: 0.028431 Oct 28 12:24:04.451991 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 693/1408] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:24:04 2021] DELETE /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:24:04.460927 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7fc4fd17-1f8f-43fe-9f27-c7cfac1e7f8a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:04.461622 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7fc4fd17-1f8f-43fe-9f27-c7cfac1e7f8a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: 19635150-a15f-4d59-a3a3-adc15a411e40] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:04.468640 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7fc4fd17-1f8f-43fe-9f27-c7cfac1e7f8a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:04.469090 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7fc4fd17-1f8f-43fe-9f27-c7cfac1e7f8a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:04.469863 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7fc4fd17-1f8f-43fe-9f27-c7cfac1e7f8a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:04.470324 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7fc4fd17-1f8f-43fe-9f27-c7cfac1e7f8a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:04.485737 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-7fc4fd17-1f8f-43fe-9f27-c7cfac1e7f8a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] HTTP exception thrown: Instance 19635150-a15f-4d59-a3a3-adc15a411e40 could not be found. Oct 28 12:24:04.486313 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7fc4fd17-1f8f-43fe-9f27-c7cfac1e7f8a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Returning 404 to user: Instance 19635150-a15f-4d59-a3a3-adc15a411e40 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:24:04.487157 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7fc4fd17-1f8f-43fe-9f27-c7cfac1e7f8a tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40" status: 404 len: 111 microversion: 2.1 time: 0.030225 Oct 28 12:24:04.487684 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 716/1409] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:24:04 2021] GET /compute/v2.1/servers/19635150-a15f-4d59-a3a3-adc15a411e40 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:24:05.090798 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4c3b5767-fcc8-44c8-9ad1-588e90890dc2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:05.091659 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4c3b5767-fcc8-44c8-9ad1-588e90890dc2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:05.098403 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4c3b5767-fcc8-44c8-9ad1-588e90890dc2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:05.098877 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4c3b5767-fcc8-44c8-9ad1-588e90890dc2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:05.099637 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4c3b5767-fcc8-44c8-9ad1-588e90890dc2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:05.100075 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4c3b5767-fcc8-44c8-9ad1-588e90890dc2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:05.188782 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4c3b5767-fcc8-44c8-9ad1-588e90890dc2 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.101610 Oct 28 12:24:05.189410 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 694/1410] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:05 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:05.609579 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ce338b00-d575-4a39-9160-23cfd11e3f2f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:05.610063 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ce338b00-d575-4a39-9160-23cfd11e3f2f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:05.616644 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce338b00-d575-4a39-9160-23cfd11e3f2f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:05.617082 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce338b00-d575-4a39-9160-23cfd11e3f2f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:05.617832 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce338b00-d575-4a39-9160-23cfd11e3f2f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:05.618253 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ce338b00-d575-4a39-9160-23cfd11e3f2f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:05.631107 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-ce338b00-d575-4a39-9160-23cfd11e3f2f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] HTTP exception thrown: Instance d79ab524-bc96-45ce-91df-6713d6fcaaaf could not be found. Oct 28 12:24:05.631666 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ce338b00-d575-4a39-9160-23cfd11e3f2f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Returning 404 to user: Instance d79ab524-bc96-45ce-91df-6713d6fcaaaf could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:24:05.632654 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ce338b00-d575-4a39-9160-23cfd11e3f2f tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "DELETE /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 404 len: 111 microversion: 2.1 time: 0.026672 Oct 28 12:24:05.633135 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 717/1411] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:24:05 2021] DELETE /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:24:05.642550 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6872de1f-3ec2-4c3b-8854-1dcc2a535e08 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:05.643273 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6872de1f-3ec2-4c3b-8854-1dcc2a535e08 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] [instance: d79ab524-bc96-45ce-91df-6713d6fcaaaf] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:05.650181 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6872de1f-3ec2-4c3b-8854-1dcc2a535e08 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:05.650626 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6872de1f-3ec2-4c3b-8854-1dcc2a535e08 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:05.651427 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6872de1f-3ec2-4c3b-8854-1dcc2a535e08 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:05.651864 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6872de1f-3ec2-4c3b-8854-1dcc2a535e08 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:05.665872 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-6872de1f-3ec2-4c3b-8854-1dcc2a535e08 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] HTTP exception thrown: Instance d79ab524-bc96-45ce-91df-6713d6fcaaaf could not be found. Oct 28 12:24:05.666451 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6872de1f-3ec2-4c3b-8854-1dcc2a535e08 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] Returning 404 to user: Instance d79ab524-bc96-45ce-91df-6713d6fcaaaf could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:24:05.667563 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6872de1f-3ec2-4c3b-8854-1dcc2a535e08 tempest-AttachVolumeShelveTestJSON-466476162 tempest-AttachVolumeShelveTestJSON-466476162-project] 10.222.0.37 "GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf" status: 404 len: 111 microversion: 2.1 time: 0.029413 Oct 28 12:24:05.668081 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 695/1412] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:24:05 2021] GET /compute/v2.1/servers/d79ab524-bc96-45ce-91df-6713d6fcaaaf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:24:06.200771 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-feb1f39a-fbc2-459b-ba94-1454b8f77eb8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:06.201819 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-feb1f39a-fbc2-459b-ba94-1454b8f77eb8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:06.208737 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-feb1f39a-fbc2-459b-ba94-1454b8f77eb8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:06.209186 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-feb1f39a-fbc2-459b-ba94-1454b8f77eb8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:06.209964 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-feb1f39a-fbc2-459b-ba94-1454b8f77eb8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:06.210398 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-feb1f39a-fbc2-459b-ba94-1454b8f77eb8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:06.274537 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-feb1f39a-fbc2-459b-ba94-1454b8f77eb8 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.077608 Oct 28 12:24:06.275255 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 718/1413] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:06 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:07.285955 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-703040c4-78f8-431b-82dd-96b0b3aa8be4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:07.286897 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-703040c4-78f8-431b-82dd-96b0b3aa8be4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:07.293345 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-703040c4-78f8-431b-82dd-96b0b3aa8be4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:07.293782 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-703040c4-78f8-431b-82dd-96b0b3aa8be4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:07.294535 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-703040c4-78f8-431b-82dd-96b0b3aa8be4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:07.294986 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-703040c4-78f8-431b-82dd-96b0b3aa8be4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:07.354323 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-703040c4-78f8-431b-82dd-96b0b3aa8be4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.072496 Oct 28 12:24:07.358172 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 696/1414] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:07 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:08.366174 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-385a6826-002a-4d7b-820f-e6e8cb8819fd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:08.367280 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-385a6826-002a-4d7b-820f-e6e8cb8819fd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:08.374417 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-385a6826-002a-4d7b-820f-e6e8cb8819fd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:08.375423 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-385a6826-002a-4d7b-820f-e6e8cb8819fd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:08.378060 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-385a6826-002a-4d7b-820f-e6e8cb8819fd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:08.378510 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-385a6826-002a-4d7b-820f-e6e8cb8819fd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:08.444713 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-385a6826-002a-4d7b-820f-e6e8cb8819fd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.081208 Oct 28 12:24:08.448680 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 719/1415] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:08 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:09.459200 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8378c72a-3c3f-41d6-bdd8-b8fbfb59add9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:09.460259 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8378c72a-3c3f-41d6-bdd8-b8fbfb59add9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:09.467148 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8378c72a-3c3f-41d6-bdd8-b8fbfb59add9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:09.467603 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8378c72a-3c3f-41d6-bdd8-b8fbfb59add9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:09.468380 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8378c72a-3c3f-41d6-bdd8-b8fbfb59add9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:09.468815 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8378c72a-3c3f-41d6-bdd8-b8fbfb59add9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:09.528984 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8378c72a-3c3f-41d6-bdd8-b8fbfb59add9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.076074 Oct 28 12:24:09.529883 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 697/1416] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:09 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:10.541819 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8a92990a-3b16-4d93-a6c0-e77a4eddef27 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:10.543021 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8a92990a-3b16-4d93-a6c0-e77a4eddef27 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:10.550494 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a92990a-3b16-4d93-a6c0-e77a4eddef27 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:10.550974 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a92990a-3b16-4d93-a6c0-e77a4eddef27 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:10.551740 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a92990a-3b16-4d93-a6c0-e77a4eddef27 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:10.552174 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8a92990a-3b16-4d93-a6c0-e77a4eddef27 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:10.615992 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8a92990a-3b16-4d93-a6c0-e77a4eddef27 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.078172 Oct 28 12:24:10.616852 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 720/1417] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:10 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:11.348002 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f366977b-2d35-481f-866a-4229507fabb3 tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] Calling method '.version_select at 0x7f11f2faaee0>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:11.393179 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f366977b-2d35-481f-866a-4229507fabb3 tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/9ef6f58c-b93b-47c1-a954-91e92022259b" status: 200 len: 350 microversion: 2.1 time: 0.049122 Oct 28 12:24:11.393741 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 698/1418] 10.222.0.37 () {58 vars in 1244 bytes} [Thu Oct 28 12:24:11 2021] GET /compute/v2.1/os-volumes/9ef6f58c-b93b-47c1-a954-91e92022259b => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:11.628824 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b2e5d039-bed6-4b0d-ab7f-bd23317caacc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:11.630312 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b2e5d039-bed6-4b0d-ab7f-bd23317caacc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:11.638336 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2e5d039-bed6-4b0d-ab7f-bd23317caacc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:11.638912 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2e5d039-bed6-4b0d-ab7f-bd23317caacc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:11.639984 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2e5d039-bed6-4b0d-ab7f-bd23317caacc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:11.640456 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b2e5d039-bed6-4b0d-ab7f-bd23317caacc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:11.702708 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b2e5d039-bed6-4b0d-ab7f-bd23317caacc tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.078473 Oct 28 12:24:11.703374 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 721/1419] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:11 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:24:12.691002 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5543e5af-8bce-4dc2-a882-bd6b072713ce tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] Calling method '.version_select at 0x7f11f2d15a60>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:12.713739 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b3ff8dd5-8aac-473b-b787-d00a4797b9aa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:12.714758 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b3ff8dd5-8aac-473b-b787-d00a4797b9aa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:12.721745 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b3ff8dd5-8aac-473b-b787-d00a4797b9aa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:12.722192 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b3ff8dd5-8aac-473b-b787-d00a4797b9aa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:12.723005 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b3ff8dd5-8aac-473b-b787-d00a4797b9aa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:12.723442 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b3ff8dd5-8aac-473b-b787-d00a4797b9aa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:12.736716 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5543e5af-8bce-4dc2-a882-bd6b072713ce tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/65677007-d89a-453d-a96b-18a6814b2b27" status: 200 len: 351 microversion: 2.1 time: 0.051059 Oct 28 12:24:12.737474 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 699/1420] 10.222.0.37 () {58 vars in 1244 bytes} [Thu Oct 28 12:24:12 2021] GET /compute/v2.1/os-volumes/65677007-d89a-453d-a96b-18a6814b2b27 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:12.785332 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b3ff8dd5-8aac-473b-b787-d00a4797b9aa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.075511 Oct 28 12:24:12.786192 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 722/1421] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:12 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:24:13.797796 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8c1e4851-c0ab-49b4-a3c3-20dced91e925 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:13.798898 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8c1e4851-c0ab-49b4-a3c3-20dced91e925 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:13.805022 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8c1e4851-c0ab-49b4-a3c3-20dced91e925 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:13.805464 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8c1e4851-c0ab-49b4-a3c3-20dced91e925 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:13.806221 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8c1e4851-c0ab-49b4-a3c3-20dced91e925 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:13.806649 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8c1e4851-c0ab-49b4-a3c3-20dced91e925 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:13.867837 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8c1e4851-c0ab-49b4-a3c3-20dced91e925 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.074021 Oct 28 12:24:13.868467 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 700/1422] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:13 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:24:14.040562 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-649c8914-b9d1-4df4-9295-00d31684585d tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] Calling method '.version_select at 0x7f11f361e700>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:14.086247 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-649c8914-b9d1-4df4-9295-00d31684585d tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/81d5435a-536f-4840-8175-3c3dea69fb39" status: 200 len: 350 microversion: 2.1 time: 0.049692 Oct 28 12:24:14.086847 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 723/1423] 10.222.0.37 () {58 vars in 1244 bytes} [Thu Oct 28 12:24:14 2021] GET /compute/v2.1/os-volumes/81d5435a-536f-4840-8175-3c3dea69fb39 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:14.098791 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bc9738b0-03bc-4f7d-8ec4-82a3ceb379f8 tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] Calling method '.version_select at 0x7f11f2f36820>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:14.175968 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bc9738b0-03bc-4f7d-8ec4-82a3ceb379f8 tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] 10.222.0.37 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.081682 Oct 28 12:24:14.176534 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 701/1424] 10.222.0.37 () {58 vars in 1133 bytes} [Thu Oct 28 12:24:14 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:24:14.189177 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-690aa252-a882-4647-8987-d770e19d71e8 tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] Calling method '.version_select at 0x7f11f808cee0>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:14.265206 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-690aa252-a882-4647-8987-d770e19d71e8 tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] 10.222.0.37 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.080513 Oct 28 12:24:14.265781 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 724/1425] 10.222.0.37 () {58 vars in 1148 bytes} [Thu Oct 28 12:24:14 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:14.278144 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-74f3657e-9536-4671-9b44-0587d676c14d tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] Calling method '.version_select at 0x7f11f2f61160>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:14.354526 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-74f3657e-9536-4671-9b44-0587d676c14d tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] 10.222.0.37 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.080326 Oct 28 12:24:14.355135 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 702/1426] 10.222.0.37 () {58 vars in 1133 bytes} [Thu Oct 28 12:24:14 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:24:14.365920 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3080a1a6-8550-4c0e-94b7-73670d504ae4 tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] Calling method '.version_select at 0x7f11f8253f70>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:14.445183 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3080a1a6-8550-4c0e-94b7-73670d504ae4 tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] 10.222.0.37 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082791 Oct 28 12:24:14.445763 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 725/1427] 10.222.0.37 () {58 vars in 1166 bytes} [Thu Oct 28 12:24:14 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:14.458215 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6392a3ad-3044-473a-aaf4-738e8a608064 tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] Calling method '.version_select at 0x7f11f8125e50>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:14.535960 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6392a3ad-3044-473a-aaf4-738e8a608064 tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082338 Oct 28 12:24:14.536579 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 703/1428] 10.222.0.37 () {58 vars in 1169 bytes} [Thu Oct 28 12:24:14 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:14.548955 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ef673553-2b08-4590-852a-5fa48093999a tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] Calling method '.version_select at 0x7f11f2cca670>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:14.631904 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ef673553-2b08-4590-852a-5fa48093999a tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086974 Oct 28 12:24:14.632479 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 726/1429] 10.222.0.37 () {58 vars in 1154 bytes} [Thu Oct 28 12:24:14 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:24:14.643988 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-64df5a0f-515a-4437-a2b5-a88c7b03c534 tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] Calling method '.version_select at 0x7f11f2f734c0>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:14.722569 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-64df5a0f-515a-4437-a2b5-a88c7b03c534 tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082253 Oct 28 12:24:14.723174 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 704/1430] 10.222.0.37 () {58 vars in 1187 bytes} [Thu Oct 28 12:24:14 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:14.734889 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-10e11e73-a37f-4ce4-9b44-dd707f1c68d1 tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] Calling method '.version_select at 0x7f11f80a8e50>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:14.879052 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-94cdb5f5-4ddb-40a5-a1c7-e4fac8a8e540 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:14.880089 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-94cdb5f5-4ddb-40a5-a1c7-e4fac8a8e540 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:14.887734 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94cdb5f5-4ddb-40a5-a1c7-e4fac8a8e540 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:14.888176 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94cdb5f5-4ddb-40a5-a1c7-e4fac8a8e540 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:14.888962 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94cdb5f5-4ddb-40a5-a1c7-e4fac8a8e540 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:14.889388 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94cdb5f5-4ddb-40a5-a1c7-e4fac8a8e540 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:14.952168 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-94cdb5f5-4ddb-40a5-a1c7-e4fac8a8e540 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.076636 Oct 28 12:24:14.956037 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 705/1431] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:14 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:24:14.964177 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-10e11e73-a37f-4ce4-9b44-dd707f1c68d1 tempest-VolumesTestJSON-1468422278 tempest-VolumesTestJSON-1468422278-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.233288 Oct 28 12:24:14.964745 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 727/1432] 10.222.0.37 () {58 vars in 1154 bytes} [Thu Oct 28 12:24:14 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:24:15.964125 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0e0f865c-228c-41ec-89b6-d1aed1c7d96c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:15.965146 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0e0f865c-228c-41ec-89b6-d1aed1c7d96c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:15.971886 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0e0f865c-228c-41ec-89b6-d1aed1c7d96c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:15.972331 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0e0f865c-228c-41ec-89b6-d1aed1c7d96c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:15.973094 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0e0f865c-228c-41ec-89b6-d1aed1c7d96c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:15.973523 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0e0f865c-228c-41ec-89b6-d1aed1c7d96c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:16.051657 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0e0f865c-228c-41ec-89b6-d1aed1c7d96c tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.091380 Oct 28 12:24:16.052277 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 706/1433] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:15 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:17.063701 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-20b0abf1-b36e-40c5-bcd1-a3209aee6eec tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:17.064616 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-20b0abf1-b36e-40c5-bcd1-a3209aee6eec tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:17.071195 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-20b0abf1-b36e-40c5-bcd1-a3209aee6eec tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:17.071632 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-20b0abf1-b36e-40c5-bcd1-a3209aee6eec tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:17.072394 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-20b0abf1-b36e-40c5-bcd1-a3209aee6eec tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:17.072819 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-20b0abf1-b36e-40c5-bcd1-a3209aee6eec tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:17.130401 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-20b0abf1-b36e-40c5-bcd1-a3209aee6eec tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.070813 Oct 28 12:24:17.131312 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 728/1434] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:17 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:18.143131 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-31c7a4cf-0206-4a60-aecd-0cb521d6e0aa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:18.144120 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-31c7a4cf-0206-4a60-aecd-0cb521d6e0aa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:18.150936 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-31c7a4cf-0206-4a60-aecd-0cb521d6e0aa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:18.151382 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-31c7a4cf-0206-4a60-aecd-0cb521d6e0aa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:18.152147 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-31c7a4cf-0206-4a60-aecd-0cb521d6e0aa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:18.152577 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-31c7a4cf-0206-4a60-aecd-0cb521d6e0aa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:18.214421 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-31c7a4cf-0206-4a60-aecd-0cb521d6e0aa tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.075865 Oct 28 12:24:18.215095 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 707/1435] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:18 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:19.226790 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7163cef1-1b15-433f-9dd9-f8ebbac2dc88 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:19.227757 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7163cef1-1b15-433f-9dd9-f8ebbac2dc88 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:19.234267 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7163cef1-1b15-433f-9dd9-f8ebbac2dc88 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:19.234723 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7163cef1-1b15-433f-9dd9-f8ebbac2dc88 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:19.236136 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7163cef1-1b15-433f-9dd9-f8ebbac2dc88 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:19.236565 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7163cef1-1b15-433f-9dd9-f8ebbac2dc88 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:19.295502 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7163cef1-1b15-433f-9dd9-f8ebbac2dc88 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.072613 Oct 28 12:24:19.296139 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 729/1436] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:19 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:20.308136 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f1134490-991a-4603-973d-2c70adde2a3b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:20.309125 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f1134490-991a-4603-973d-2c70adde2a3b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:20.316567 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f1134490-991a-4603-973d-2c70adde2a3b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:20.316992 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f1134490-991a-4603-973d-2c70adde2a3b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:20.317761 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f1134490-991a-4603-973d-2c70adde2a3b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:20.318192 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f1134490-991a-4603-973d-2c70adde2a3b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:20.382227 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f1134490-991a-4603-973d-2c70adde2a3b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.077913 Oct 28 12:24:20.386061 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 708/1437] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:20 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:21.394425 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-51e56cd2-6066-4550-9151-e03e6ab1dfae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:21.395479 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-51e56cd2-6066-4550-9151-e03e6ab1dfae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:21.402226 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-51e56cd2-6066-4550-9151-e03e6ab1dfae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:21.402667 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-51e56cd2-6066-4550-9151-e03e6ab1dfae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:21.403535 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-51e56cd2-6066-4550-9151-e03e6ab1dfae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:21.403966 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-51e56cd2-6066-4550-9151-e03e6ab1dfae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:21.464352 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-51e56cd2-6066-4550-9151-e03e6ab1dfae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.074471 Oct 28 12:24:21.465326 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 730/1438] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:21 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:22.476675 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f63a0ff2-b2c1-4642-b1b2-da20527bf021 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:22.477677 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f63a0ff2-b2c1-4642-b1b2-da20527bf021 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:22.484461 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f63a0ff2-b2c1-4642-b1b2-da20527bf021 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:22.484906 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f63a0ff2-b2c1-4642-b1b2-da20527bf021 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:22.485675 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f63a0ff2-b2c1-4642-b1b2-da20527bf021 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:22.486107 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f63a0ff2-b2c1-4642-b1b2-da20527bf021 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:22.554714 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f63a0ff2-b2c1-4642-b1b2-da20527bf021 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.081902 Oct 28 12:24:22.555378 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 709/1439] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:22 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:24:23.566998 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8efb035c-4cd1-43af-ae18-6b3f5b78dca1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:23.568163 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8efb035c-4cd1-43af-ae18-6b3f5b78dca1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:23.574938 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8efb035c-4cd1-43af-ae18-6b3f5b78dca1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:23.575366 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8efb035c-4cd1-43af-ae18-6b3f5b78dca1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:23.576123 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8efb035c-4cd1-43af-ae18-6b3f5b78dca1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:23.576551 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8efb035c-4cd1-43af-ae18-6b3f5b78dca1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:23.636105 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8efb035c-4cd1-43af-ae18-6b3f5b78dca1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.073413 Oct 28 12:24:23.640121 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 731/1440] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:23 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:24.648161 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f2d3b779-4d6d-4137-b397-70075f15f279 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:24.649188 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f2d3b779-4d6d-4137-b397-70075f15f279 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:24.656314 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f2d3b779-4d6d-4137-b397-70075f15f279 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:24.656761 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f2d3b779-4d6d-4137-b397-70075f15f279 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:24.657527 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f2d3b779-4d6d-4137-b397-70075f15f279 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:24.657955 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f2d3b779-4d6d-4137-b397-70075f15f279 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:24.717931 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f2d3b779-4d6d-4137-b397-70075f15f279 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.073548 Oct 28 12:24:24.718806 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 710/1441] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:24 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:25.730768 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-fe4b576a-18fb-4208-82d8-72a9f313a1d4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:25.731879 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-fe4b576a-18fb-4208-82d8-72a9f313a1d4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:25.739326 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe4b576a-18fb-4208-82d8-72a9f313a1d4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:25.739944 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe4b576a-18fb-4208-82d8-72a9f313a1d4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:25.740779 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe4b576a-18fb-4208-82d8-72a9f313a1d4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:25.741211 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-fe4b576a-18fb-4208-82d8-72a9f313a1d4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:25.800052 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-fe4b576a-18fb-4208-82d8-72a9f313a1d4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.073238 Oct 28 12:24:25.800931 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 732/1442] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:25 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:26.812264 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-98003e42-6145-45f5-84a6-a9f3bfd0629a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:26.813252 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-98003e42-6145-45f5-84a6-a9f3bfd0629a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:26.820572 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-98003e42-6145-45f5-84a6-a9f3bfd0629a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:26.821012 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-98003e42-6145-45f5-84a6-a9f3bfd0629a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:26.821777 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-98003e42-6145-45f5-84a6-a9f3bfd0629a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:26.822205 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-98003e42-6145-45f5-84a6-a9f3bfd0629a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:26.881688 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-98003e42-6145-45f5-84a6-a9f3bfd0629a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.073375 Oct 28 12:24:26.885465 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 711/1443] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:26 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:27.893605 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b6f077bb-e81c-4669-b1d3-ff8de799dfd7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:27.894598 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b6f077bb-e81c-4669-b1d3-ff8de799dfd7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:27.901773 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b6f077bb-e81c-4669-b1d3-ff8de799dfd7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:27.902356 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b6f077bb-e81c-4669-b1d3-ff8de799dfd7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:27.903312 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b6f077bb-e81c-4669-b1d3-ff8de799dfd7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:27.903848 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b6f077bb-e81c-4669-b1d3-ff8de799dfd7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:27.976206 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b6f077bb-e81c-4669-b1d3-ff8de799dfd7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 28680 microversion: 2.1 time: 0.086468 Oct 28 12:24:27.976877 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 733/1444] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:27 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 28680 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:28.987902 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-85b13bac-4e92-4cda-a825-c47d60300370 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:28.988899 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-85b13bac-4e92-4cda-a825-c47d60300370 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:28.995723 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-85b13bac-4e92-4cda-a825-c47d60300370 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:28.996218 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-85b13bac-4e92-4cda-a825-c47d60300370 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:28.996937 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-85b13bac-4e92-4cda-a825-c47d60300370 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:28.997368 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-85b13bac-4e92-4cda-a825-c47d60300370 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:29.083134 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-85b13bac-4e92-4cda-a825-c47d60300370 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 29059 microversion: 2.1 time: 0.099006 Oct 28 12:24:29.084008 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 712/1445] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:28 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 29059 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:30.096520 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-9d10b116-05bf-42d1-8e96-47b168ea4725 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:30.097535 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-9d10b116-05bf-42d1-8e96-47b168ea4725 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:30.104386 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d10b116-05bf-42d1-8e96-47b168ea4725 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:30.104829 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d10b116-05bf-42d1-8e96-47b168ea4725 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:30.105594 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d10b116-05bf-42d1-8e96-47b168ea4725 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:30.106023 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-9d10b116-05bf-42d1-8e96-47b168ea4725 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:30.181025 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-9d10b116-05bf-42d1-8e96-47b168ea4725 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 31207 microversion: 2.1 time: 0.088679 Oct 28 12:24:30.181644 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 734/1446] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:30 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 31207 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:31.193062 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ebaa5d19-0637-49f0-a6c3-266cec3af0cf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:31.194039 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ebaa5d19-0637-49f0-a6c3-266cec3af0cf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:31.201215 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ebaa5d19-0637-49f0-a6c3-266cec3af0cf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:31.201652 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ebaa5d19-0637-49f0-a6c3-266cec3af0cf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:31.202403 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ebaa5d19-0637-49f0-a6c3-266cec3af0cf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:31.202865 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ebaa5d19-0637-49f0-a6c3-266cec3af0cf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:31.273448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ebaa5d19-0637-49f0-a6c3-266cec3af0cf tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 32938 microversion: 2.1 time: 0.084298 Oct 28 12:24:31.274058 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 713/1447] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:31 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 32938 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:32.286017 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-87f7b443-c241-4961-b21d-5ae0422dba0a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:32.287024 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-87f7b443-c241-4961-b21d-5ae0422dba0a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:32.294064 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-87f7b443-c241-4961-b21d-5ae0422dba0a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:32.294506 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-87f7b443-c241-4961-b21d-5ae0422dba0a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:32.295297 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-87f7b443-c241-4961-b21d-5ae0422dba0a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:32.295726 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-87f7b443-c241-4961-b21d-5ae0422dba0a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:32.367393 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-87f7b443-c241-4961-b21d-5ae0422dba0a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 33832 microversion: 2.1 time: 0.085225 Oct 28 12:24:32.368333 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 735/1448] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:32 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 33832 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:33.380480 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f3ad72e0-d835-427c-b5a8-b08f45024c68 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:33.381456 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f3ad72e0-d835-427c-b5a8-b08f45024c68 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:33.388340 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f3ad72e0-d835-427c-b5a8-b08f45024c68 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:33.388782 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f3ad72e0-d835-427c-b5a8-b08f45024c68 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:33.389536 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f3ad72e0-d835-427c-b5a8-b08f45024c68 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:33.389962 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f3ad72e0-d835-427c-b5a8-b08f45024c68 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:33.461672 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f3ad72e0-d835-427c-b5a8-b08f45024c68 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 35173 microversion: 2.1 time: 0.085683 Oct 28 12:24:33.462384 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 714/1449] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:33 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 35173 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:34.474451 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-68d18bb6-715d-4546-8830-d677295ee0a3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:34.475535 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-68d18bb6-715d-4546-8830-d677295ee0a3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:34.482345 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-68d18bb6-715d-4546-8830-d677295ee0a3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:34.482822 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-68d18bb6-715d-4546-8830-d677295ee0a3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:34.483596 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-68d18bb6-715d-4546-8830-d677295ee0a3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:34.484056 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-68d18bb6-715d-4546-8830-d677295ee0a3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:34.555252 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-68d18bb6-715d-4546-8830-d677295ee0a3 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 36666 microversion: 2.1 time: 0.085253 Oct 28 12:24:34.555901 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 736/1450] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:34 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 36666 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:35.567516 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-041b0ce8-10be-4ee6-9715-933600246cc4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:35.568628 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-041b0ce8-10be-4ee6-9715-933600246cc4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:35.575453 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-041b0ce8-10be-4ee6-9715-933600246cc4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:35.575896 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-041b0ce8-10be-4ee6-9715-933600246cc4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:35.576651 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-041b0ce8-10be-4ee6-9715-933600246cc4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:35.577081 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-041b0ce8-10be-4ee6-9715-933600246cc4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:35.649056 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-041b0ce8-10be-4ee6-9715-933600246cc4 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 38211 microversion: 2.1 time: 0.085515 Oct 28 12:24:35.649696 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 715/1451] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:35 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 38211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:36.661387 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-141916a8-f21b-4cb0-8a11-3c7e575f96a9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:36.662364 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-141916a8-f21b-4cb0-8a11-3c7e575f96a9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:36.669394 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-141916a8-f21b-4cb0-8a11-3c7e575f96a9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:36.669828 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-141916a8-f21b-4cb0-8a11-3c7e575f96a9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:36.670583 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-141916a8-f21b-4cb0-8a11-3c7e575f96a9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:36.671031 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-141916a8-f21b-4cb0-8a11-3c7e575f96a9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:36.733164 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-141916a8-f21b-4cb0-8a11-3c7e575f96a9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 38211 microversion: 2.1 time: 0.075693 Oct 28 12:24:36.733800 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 737/1452] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:36 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 38211 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:37.745355 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6612052d-ff6c-473a-8902-ef8019219b29 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:37.746340 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6612052d-ff6c-473a-8902-ef8019219b29 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:37.753117 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6612052d-ff6c-473a-8902-ef8019219b29 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:37.753554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6612052d-ff6c-473a-8902-ef8019219b29 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:37.754403 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6612052d-ff6c-473a-8902-ef8019219b29 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:37.754860 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6612052d-ff6c-473a-8902-ef8019219b29 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:37.816145 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6612052d-ff6c-473a-8902-ef8019219b29 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 38211 microversion: 2.1 time: 0.074631 Oct 28 12:24:37.816895 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 716/1453] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:37 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 38211 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:38.828519 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-876805fa-399d-4456-8037-2921d4a14dd7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:38.829515 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-876805fa-399d-4456-8037-2921d4a14dd7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:38.837112 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-876805fa-399d-4456-8037-2921d4a14dd7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:38.837743 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-876805fa-399d-4456-8037-2921d4a14dd7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:38.838506 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-876805fa-399d-4456-8037-2921d4a14dd7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:38.839093 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-876805fa-399d-4456-8037-2921d4a14dd7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:38.903188 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-876805fa-399d-4456-8037-2921d4a14dd7 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 38211 microversion: 2.1 time: 0.078177 Oct 28 12:24:38.903946 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 738/1454] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:38 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 38211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:24:39.916246 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ca1221c5-4317-4912-8bb4-be340275a2f9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:39.917483 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ca1221c5-4317-4912-8bb4-be340275a2f9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:39.924242 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca1221c5-4317-4912-8bb4-be340275a2f9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:39.924677 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca1221c5-4317-4912-8bb4-be340275a2f9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:39.925613 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca1221c5-4317-4912-8bb4-be340275a2f9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:39.926046 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ca1221c5-4317-4912-8bb4-be340275a2f9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:40.002217 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ca1221c5-4317-4912-8bb4-be340275a2f9 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 38211 microversion: 2.1 time: 0.090090 Oct 28 12:24:40.006914 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 717/1455] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:39 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 38211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:41.015779 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-67e7f65d-09b1-4790-8bf0-80f3d602cec1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:41.016785 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-67e7f65d-09b1-4790-8bf0-80f3d602cec1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:41.024666 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-67e7f65d-09b1-4790-8bf0-80f3d602cec1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:41.025123 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-67e7f65d-09b1-4790-8bf0-80f3d602cec1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:41.025890 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-67e7f65d-09b1-4790-8bf0-80f3d602cec1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:41.026321 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-67e7f65d-09b1-4790-8bf0-80f3d602cec1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:41.118028 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-67e7f65d-09b1-4790-8bf0-80f3d602cec1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action" status: 200 len: 38340 microversion: 2.1 time: 0.106855 Oct 28 12:24:41.119451 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 739/1456] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:24:41 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/action => generated 38340 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:24:41.128956 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-b531669a-10cf-447a-a851-09dde04b3b7f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:41.129535 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-b531669a-10cf-447a-a851-09dde04b3b7f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:41.137077 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b531669a-10cf-447a-a851-09dde04b3b7f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:41.137521 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b531669a-10cf-447a-a851-09dde04b3b7f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:41.138289 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b531669a-10cf-447a-a851-09dde04b3b7f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:41.139515 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-b531669a-10cf-447a-a851-09dde04b3b7f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:41.165087 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-b531669a-10cf-447a-a851-09dde04b3b7f tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/ips" status: 200 len: 145 microversion: 2.1 time: 0.040035 Oct 28 12:24:41.165813 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 718/1457] 10.222.0.37 () {58 vars in 1247 bytes} [Thu Oct 28 12:24:41 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:24:42.478133 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5bbf6a13-9f60-4eb7-a253-ee9d06656be0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "343ba2d0-ee28-4c96-9539-2676e7878670"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:42.479479 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5bbf6a13-9f60-4eb7-a253-ee9d06656be0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:42.486236 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5bbf6a13-9f60-4eb7-a253-ee9d06656be0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:42.486711 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5bbf6a13-9f60-4eb7-a253-ee9d06656be0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:42.487495 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5bbf6a13-9f60-4eb7-a253-ee9d06656be0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:42.487937 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5bbf6a13-9f60-4eb7-a253-ee9d06656be0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:42.725797 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5bbf6a13-9f60-4eb7-a253-ee9d06656be0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255221 Oct 28 12:24:42.726550 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 740/1458] 10.222.0.37 () {60 vars in 1322 bytes} [Thu Oct 28 12:24:42 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:50.192292 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8a2de375-1834-48a0-9b95-8068ce088a63 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:50.193569 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8a2de375-1834-48a0-9b95-8068ce088a63 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:50.200546 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8a2de375-1834-48a0-9b95-8068ce088a63 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:50.201174 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8a2de375-1834-48a0-9b95-8068ce088a63 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:50.202003 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8a2de375-1834-48a0-9b95-8068ce088a63 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:50.206731 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8a2de375-1834-48a0-9b95-8068ce088a63 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:50.240106 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8a2de375-1834-48a0-9b95-8068ce088a63 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052793 Oct 28 12:24:50.240677 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 719/1459] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:24:50 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:50.251502 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-809b6b61-899d-417a-a5a2-c8cd55581fbd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:50.252074 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-809b6b61-899d-417a-a5a2-c8cd55581fbd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:50.259301 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-809b6b61-899d-417a-a5a2-c8cd55581fbd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:50.259752 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-809b6b61-899d-417a-a5a2-c8cd55581fbd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:50.260520 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-809b6b61-899d-417a-a5a2-c8cd55581fbd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:50.260952 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-809b6b61-899d-417a-a5a2-c8cd55581fbd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:50.288963 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-809b6b61-899d-417a-a5a2-c8cd55581fbd tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments/343ba2d0-ee28-4c96-9539-2676e7878670" status: 200 len: 194 microversion: 2.1 time: 0.042108 Oct 28 12:24:50.289557 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 741/1460] 10.222.0.37 () {58 vars in 1412 bytes} [Thu Oct 28 12:24:50 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments/343ba2d0-ee28-4c96-9539-2676e7878670 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:51.596263 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a1200cb5-e61c-4bff-8577-11822e33f713 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ff402a0-cdac-4c59-bb71-45efda23b796"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:24:51.597318 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a1200cb5-e61c-4bff-8577-11822e33f713 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:51.603531 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a1200cb5-e61c-4bff-8577-11822e33f713 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:51.603979 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a1200cb5-e61c-4bff-8577-11822e33f713 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:51.604751 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a1200cb5-e61c-4bff-8577-11822e33f713 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:51.605182 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a1200cb5-e61c-4bff-8577-11822e33f713 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:51.863426 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a1200cb5-e61c-4bff-8577-11822e33f713 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270693 Oct 28 12:24:51.864686 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 720/1461] 10.222.0.37 () {60 vars in 1322 bytes} [Thu Oct 28 12:24:51 2021] POST /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:59.316744 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2e936d08-0885-4c50-928f-a96c7ba7e750 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:59.317657 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2e936d08-0885-4c50-928f-a96c7ba7e750 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:59.323986 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2e936d08-0885-4c50-928f-a96c7ba7e750 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:59.324434 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2e936d08-0885-4c50-928f-a96c7ba7e750 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:59.325200 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2e936d08-0885-4c50-928f-a96c7ba7e750 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:59.325632 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2e936d08-0885-4c50-928f-a96c7ba7e750 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:59.355752 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2e936d08-0885-4c50-928f-a96c7ba7e750 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042838 Oct 28 12:24:59.356313 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 742/1462] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:24:59 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:59.570133 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ea3c6005-4620-4cd2-ac64-d3e4f3c5cb23 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:59.570709 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ea3c6005-4620-4cd2-ac64-d3e4f3c5cb23 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:59.577310 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ea3c6005-4620-4cd2-ac64-d3e4f3c5cb23 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:59.577753 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ea3c6005-4620-4cd2-ac64-d3e4f3c5cb23 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:59.578526 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ea3c6005-4620-4cd2-ac64-d3e4f3c5cb23 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:59.578990 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ea3c6005-4620-4cd2-ac64-d3e4f3c5cb23 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:59.607691 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ea3c6005-4620-4cd2-ac64-d3e4f3c5cb23 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments/343ba2d0-ee28-4c96-9539-2676e7878670" status: 200 len: 194 microversion: 2.1 time: 0.042565 Oct 28 12:24:59.608278 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 721/1463] 10.222.0.37 () {58 vars in 1412 bytes} [Thu Oct 28 12:24:59 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments/343ba2d0-ee28-4c96-9539-2676e7878670 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:24:59.617867 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3867d66f-dbf4-455b-b6d7-a0f82b58b645 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:24:59.618220 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3867d66f-dbf4-455b-b6d7-a0f82b58b645 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:24:59.624803 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3867d66f-dbf4-455b-b6d7-a0f82b58b645 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:59.625251 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3867d66f-dbf4-455b-b6d7-a0f82b58b645 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:59.626067 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3867d66f-dbf4-455b-b6d7-a0f82b58b645 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:24:59.627319 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3867d66f-dbf4-455b-b6d7-a0f82b58b645 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:24:59.706962 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-3867d66f-dbf4-455b-b6d7-a0f82b58b645 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lazy-loading 'services' on Instance uuid b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:24:59.780533 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3867d66f-dbf4-455b-b6d7-a0f82b58b645 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "DELETE /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments/343ba2d0-ee28-4c96-9539-2676e7878670" status: 202 len: 0 microversion: 2.1 time: 0.166426 Oct 28 12:24:59.781116 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 743/1464] 10.222.0.37 () {58 vars in 1415 bytes} [Thu Oct 28 12:24:59 2021] DELETE /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments/343ba2d0-ee28-4c96-9539-2676e7878670 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:25:00.908579 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2bbabc12-b3f1-4af6-a842-c441f9863b05 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:00.909071 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2bbabc12-b3f1-4af6-a842-c441f9863b05 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:25:00.915827 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2bbabc12-b3f1-4af6-a842-c441f9863b05 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:00.916516 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2bbabc12-b3f1-4af6-a842-c441f9863b05 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:00.917550 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2bbabc12-b3f1-4af6-a842-c441f9863b05 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:00.918122 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2bbabc12-b3f1-4af6-a842-c441f9863b05 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:00.947249 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2bbabc12-b3f1-4af6-a842-c441f9863b05 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments/6ff402a0-cdac-4c59-bb71-45efda23b796" status: 200 len: 194 microversion: 2.1 time: 0.042347 Oct 28 12:25:00.947852 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 722/1465] 10.222.0.37 () {58 vars in 1412 bytes} [Thu Oct 28 12:25:00 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments/6ff402a0-cdac-4c59-bb71-45efda23b796 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:25:00.958879 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8fb54fff-0205-4251-865b-0a3daef618ab tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:00.959447 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8fb54fff-0205-4251-865b-0a3daef618ab tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:25:00.965653 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8fb54fff-0205-4251-865b-0a3daef618ab tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:00.966091 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8fb54fff-0205-4251-865b-0a3daef618ab tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:00.966884 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8fb54fff-0205-4251-865b-0a3daef618ab tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:00.967312 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8fb54fff-0205-4251-865b-0a3daef618ab tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:01.043985 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-8fb54fff-0205-4251-865b-0a3daef618ab tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lazy-loading 'services' on Instance uuid b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:25:01.111873 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8fb54fff-0205-4251-865b-0a3daef618ab tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "DELETE /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments/6ff402a0-cdac-4c59-bb71-45efda23b796" status: 202 len: 0 microversion: 2.1 time: 0.158081 Oct 28 12:25:01.112594 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 744/1466] 10.222.0.37 () {58 vars in 1415 bytes} [Thu Oct 28 12:25:00 2021] DELETE /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments/6ff402a0-cdac-4c59-bb71-45efda23b796 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:25:02.264439 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-8e044858-6d64-46a9-8551-3b8cea70040d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:02.265367 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-8e044858-6d64-46a9-8551-3b8cea70040d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:25:02.271978 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8e044858-6d64-46a9-8551-3b8cea70040d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:02.272425 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8e044858-6d64-46a9-8551-3b8cea70040d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:02.273200 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8e044858-6d64-46a9-8551-3b8cea70040d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:02.273634 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-8e044858-6d64-46a9-8551-3b8cea70040d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:02.301696 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-8e044858-6d64-46a9-8551-3b8cea70040d tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040973 Oct 28 12:25:02.302243 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 723/1467] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:25:02 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:25:02.400146 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ef4bdb6b-dab8-48ce-855e-f42f435e83cb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:02.401215 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ef4bdb6b-dab8-48ce-855e-f42f435e83cb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:25:02.407240 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ef4bdb6b-dab8-48ce-855e-f42f435e83cb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:02.407687 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ef4bdb6b-dab8-48ce-855e-f42f435e83cb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:02.408449 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ef4bdb6b-dab8-48ce-855e-f42f435e83cb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:02.408875 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ef4bdb6b-dab8-48ce-855e-f42f435e83cb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:02.437379 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ef4bdb6b-dab8-48ce-855e-f42f435e83cb tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041705 Oct 28 12:25:02.437865 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 745/1468] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:25:02 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:25:02.491407 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a16d47ca-7283-48db-8830-ae8b1509f16e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:02.491929 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a16d47ca-7283-48db-8830-ae8b1509f16e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:25:02.497613 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a16d47ca-7283-48db-8830-ae8b1509f16e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:02.498058 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a16d47ca-7283-48db-8830-ae8b1509f16e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:02.498862 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a16d47ca-7283-48db-8830-ae8b1509f16e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:02.499297 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a16d47ca-7283-48db-8830-ae8b1509f16e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:02.523762 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a16d47ca-7283-48db-8830-ae8b1509f16e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Going to try to terminate instance {{(pid=115797) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:25:02.594726 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a16d47ca-7283-48db-8830-ae8b1509f16e tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "DELETE /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43" status: 204 len: 0 microversion: 2.1 time: 0.106633 Oct 28 12:25:02.595315 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 724/1469] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:25:02 2021] DELETE /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:25:02.603242 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3bd452d3-2d5e-4990-b3b4-037a7bb888ad tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:02.603961 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3bd452d3-2d5e-4990-b3b4-037a7bb888ad tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:25:02.610114 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3bd452d3-2d5e-4990-b3b4-037a7bb888ad tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:02.610561 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3bd452d3-2d5e-4990-b3b4-037a7bb888ad tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:02.611359 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3bd452d3-2d5e-4990-b3b4-037a7bb888ad tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:02.611786 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3bd452d3-2d5e-4990-b3b4-037a7bb888ad tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:02.741117 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3bd452d3-2d5e-4990-b3b4-037a7bb888ad tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:25:02.748508 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3bd452d3-2d5e-4990-b3b4-037a7bb888ad tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43" status: 200 len: 1671 microversion: 2.1 time: 0.148918 Oct 28 12:25:02.749074 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 746/1470] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:25:02 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 => generated 1671 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:25:03.765767 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-836a3cd0-0407-4109-a577-5cf02667c89a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:03.766464 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-836a3cd0-0407-4109-a577-5cf02667c89a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:25:03.773411 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-836a3cd0-0407-4109-a577-5cf02667c89a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:03.773862 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-836a3cd0-0407-4109-a577-5cf02667c89a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:03.774640 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-836a3cd0-0407-4109-a577-5cf02667c89a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:03.775101 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-836a3cd0-0407-4109-a577-5cf02667c89a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:03.906214 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-836a3cd0-0407-4109-a577-5cf02667c89a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:25:03.914350 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-836a3cd0-0407-4109-a577-5cf02667c89a tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43" status: 200 len: 1671 microversion: 2.1 time: 0.152620 Oct 28 12:25:03.914959 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 725/1471] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:25:03 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:25:04.932080 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-883ace3c-ee82-4124-8253-598058772da0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:04.932922 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-883ace3c-ee82-4124-8253-598058772da0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:25:04.939142 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-883ace3c-ee82-4124-8253-598058772da0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:04.939808 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-883ace3c-ee82-4124-8253-598058772da0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:04.940579 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-883ace3c-ee82-4124-8253-598058772da0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:04.941483 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-883ace3c-ee82-4124-8253-598058772da0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:05.183676 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-883ace3c-ee82-4124-8253-598058772da0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:25:05.191031 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-883ace3c-ee82-4124-8253-598058772da0 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43" status: 200 len: 1671 microversion: 2.1 time: 0.262735 Oct 28 12:25:05.192360 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 747/1472] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:25:04 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 => generated 1671 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:25:05.732726 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-eea098c7-8e0f-498a-ade3-a370c79209fe req-973f0c1a-c475-47df-8432-1d955ddae4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36bb8ba-2277-44a6-afc5-82fb6b3c2f43", "name": "network-vif-deleted", "tag": "502a1ac2-2e78-4cbb-91b0-ce62e1165360"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:25:05.735127 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:25:05.735127 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:25:05.751789 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-eea098c7-8e0f-498a-ade3-a370c79209fe req-973f0c1a-c475-47df-8432-1d955ddae4e2 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:05.752708 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-eea098c7-8e0f-498a-ade3-a370c79209fe req-973f0c1a-c475-47df-8432-1d955ddae4e2 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:05.772132 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-eea098c7-8e0f-498a-ade3-a370c79209fe req-973f0c1a-c475-47df-8432-1d955ddae4e2 service nova] Creating event network-vif-deleted:502a1ac2-2e78-4cbb-91b0-ce62e1165360 for instance b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 on hv-cinder-81571 Oct 28 12:25:05.783711 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-eea098c7-8e0f-498a-ade3-a370c79209fe req-973f0c1a-c475-47df-8432-1d955ddae4e2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061027 Oct 28 12:25:05.785622 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 726/1473] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:25:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:25:06.208746 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ffdf9288-b727-4e10-9953-3cc57cd06432 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:06.209355 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ffdf9288-b727-4e10-9953-3cc57cd06432 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:25:06.216651 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ffdf9288-b727-4e10-9953-3cc57cd06432 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:06.217096 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ffdf9288-b727-4e10-9953-3cc57cd06432 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:06.217956 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ffdf9288-b727-4e10-9953-3cc57cd06432 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:06.218384 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ffdf9288-b727-4e10-9953-3cc57cd06432 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:06.254075 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ffdf9288-b727-4e10-9953-3cc57cd06432 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:06.254590 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ffdf9288-b727-4e10-9953-3cc57cd06432 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:06.255070 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.objects.instance [None req-ffdf9288-b727-4e10-9953-3cc57cd06432 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lazy-loading 'fault' on Instance uuid b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 {{(pid=115798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:25:06.299756 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ffdf9288-b727-4e10-9953-3cc57cd06432 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e4266183744daea8c01bd9f3b503e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9312b8e64f51472da613ba9a553d6c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:25:06.306443 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ffdf9288-b727-4e10-9953-3cc57cd06432 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43" status: 200 len: 1326 microversion: 2.1 time: 0.102010 Oct 28 12:25:06.307055 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 748/1474] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:25:06 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 => generated 1326 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:25:07.324268 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-304cf249-763d-487f-8d73-481d9f2324ae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:07.324958 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-304cf249-763d-487f-8d73-481d9f2324ae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:25:07.331069 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-304cf249-763d-487f-8d73-481d9f2324ae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:07.331516 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-304cf249-763d-487f-8d73-481d9f2324ae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:07.332284 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-304cf249-763d-487f-8d73-481d9f2324ae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:07.332715 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-304cf249-763d-487f-8d73-481d9f2324ae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:07.347353 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-304cf249-763d-487f-8d73-481d9f2324ae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] HTTP exception thrown: Instance b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 could not be found. Oct 28 12:25:07.347926 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-304cf249-763d-487f-8d73-481d9f2324ae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Returning 404 to user: Instance b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:25:07.349362 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-304cf249-763d-487f-8d73-481d9f2324ae tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43" status: 404 len: 111 microversion: 2.1 time: 0.029013 Oct 28 12:25:07.349902 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 727/1475] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:25:07 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:25:07.357738 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-bb5a8794-6d8d-4a65-a9b7-1e2f7e297cad tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '.version_select at 0x7f11f377e040>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:07.374409 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-bb5a8794-6d8d-4a65-a9b7-1e2f7e297cad tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-195437106" status: 202 len: 0 microversion: 2.1 time: 0.020206 Oct 28 12:25:07.374979 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 749/1476] 10.222.0.37 () {58 vars in 1217 bytes} [Thu Oct 28 12:25:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-195437106 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:25:10.243890 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6402072e-ff7f-4c3b-8194-12adb7b443f1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:10.244380 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-6402072e-ff7f-4c3b-8194-12adb7b443f1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:25:10.250483 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6402072e-ff7f-4c3b-8194-12adb7b443f1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:10.250959 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6402072e-ff7f-4c3b-8194-12adb7b443f1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:10.251740 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6402072e-ff7f-4c3b-8194-12adb7b443f1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:10.252171 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-6402072e-ff7f-4c3b-8194-12adb7b443f1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:10.265629 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-6402072e-ff7f-4c3b-8194-12adb7b443f1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] HTTP exception thrown: Instance b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 could not be found. Oct 28 12:25:10.266197 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-6402072e-ff7f-4c3b-8194-12adb7b443f1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Returning 404 to user: Instance b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:25:10.267058 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-6402072e-ff7f-4c3b-8194-12adb7b443f1 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "DELETE /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43" status: 404 len: 111 microversion: 2.1 time: 0.026782 Oct 28 12:25:10.267574 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 728/1477] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:25:10 2021] DELETE /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:25:10.276323 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-57196aac-3d17-4c25-bd59-8d6f1c6a6e8b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:10.276950 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-57196aac-3d17-4c25-bd59-8d6f1c6a6e8b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: b36bb8ba-2277-44a6-afc5-82fb6b3c2f43] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:25:10.283561 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-57196aac-3d17-4c25-bd59-8d6f1c6a6e8b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:10.283998 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-57196aac-3d17-4c25-bd59-8d6f1c6a6e8b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:10.284747 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-57196aac-3d17-4c25-bd59-8d6f1c6a6e8b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:10.285172 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-57196aac-3d17-4c25-bd59-8d6f1c6a6e8b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:10.297904 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-57196aac-3d17-4c25-bd59-8d6f1c6a6e8b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] HTTP exception thrown: Instance b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 could not be found. Oct 28 12:25:10.298468 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-57196aac-3d17-4c25-bd59-8d6f1c6a6e8b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Returning 404 to user: Instance b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:25:10.299302 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-57196aac-3d17-4c25-bd59-8d6f1c6a6e8b tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43" status: 404 len: 111 microversion: 2.1 time: 0.027808 Oct 28 12:25:10.299838 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 750/1478] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:25:10 2021] GET /compute/v2.1/servers/b36bb8ba-2277-44a6-afc5-82fb6b3c2f43 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:25:11.422893 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f418c0e8-6628-4608-8b09-296777a6eb69 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:11.423385 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f418c0e8-6628-4608-8b09-296777a6eb69 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:25:11.429567 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f418c0e8-6628-4608-8b09-296777a6eb69 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:11.430093 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f418c0e8-6628-4608-8b09-296777a6eb69 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:11.430891 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f418c0e8-6628-4608-8b09-296777a6eb69 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:11.431341 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f418c0e8-6628-4608-8b09-296777a6eb69 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:11.444097 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-f418c0e8-6628-4608-8b09-296777a6eb69 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] HTTP exception thrown: Instance e3cfb902-8c2c-4a98-b226-147d495a83e9 could not be found. Oct 28 12:25:11.444664 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f418c0e8-6628-4608-8b09-296777a6eb69 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Returning 404 to user: Instance e3cfb902-8c2c-4a98-b226-147d495a83e9 could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:25:11.445492 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f418c0e8-6628-4608-8b09-296777a6eb69 tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 404 len: 111 microversion: 2.1 time: 0.026221 Oct 28 12:25:11.446001 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 729/1479] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:25:11 2021] DELETE /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:25:11.453507 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-47502bf2-fe54-4b6e-a50f-3b4c2343e7ba tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:11.454145 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-47502bf2-fe54-4b6e-a50f-3b4c2343e7ba tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] [instance: e3cfb902-8c2c-4a98-b226-147d495a83e9] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:25:11.460910 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47502bf2-fe54-4b6e-a50f-3b4c2343e7ba tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:11.461355 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47502bf2-fe54-4b6e-a50f-3b4c2343e7ba tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:11.462123 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47502bf2-fe54-4b6e-a50f-3b4c2343e7ba tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:11.462557 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-47502bf2-fe54-4b6e-a50f-3b4c2343e7ba tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:11.475965 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-47502bf2-fe54-4b6e-a50f-3b4c2343e7ba tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] HTTP exception thrown: Instance e3cfb902-8c2c-4a98-b226-147d495a83e9 could not be found. Oct 28 12:25:11.476536 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-47502bf2-fe54-4b6e-a50f-3b4c2343e7ba tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] Returning 404 to user: Instance e3cfb902-8c2c-4a98-b226-147d495a83e9 could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:25:11.477375 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-47502bf2-fe54-4b6e-a50f-3b4c2343e7ba tempest-AttachVolumeTestJSON-1367448043 tempest-AttachVolumeTestJSON-1367448043-project] 10.222.0.37 "GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9" status: 404 len: 111 microversion: 2.1 time: 0.027572 Oct 28 12:25:11.477886 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 751/1480] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:25:11 2021] GET /compute/v2.1/servers/e3cfb902-8c2c-4a98-b226-147d495a83e9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:25:51.600492 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:25:51.601212 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: Thu Oct 28 12:25:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:25:52.232740 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:25:52.232740 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: Thu Oct 28 12:25:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:25:56.572486 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-26a461bb-5a72-4654-8712-ad9e026c5403 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-413584542", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-372409146", "security_groups": [{"name": "tempest-secgroup-smoke-1117697042"}], "block_device_mapping_v2": [{"uuid": "2375b2d2-fca5-4c05-be72-9afcd49d7289", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0274befd-d9a1-4ff6-a2b6-a21e079de445"}]}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:25:56.704266 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-26a461bb-5a72-4654-8712-ad9e026c5403 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] validate_networks() for [('0274befd-d9a1-4ff6-a2b6-a21e079de445', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:25:57.257086 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-26a461bb-5a72-4654-8712-ad9e026c5403 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:25:57.257503 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-26a461bb-5a72-4654-8712-ad9e026c5403 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:25:57.257984 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-26a461bb-5a72-4654-8712-ad9e026c5403 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:25:57.258374 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-26a461bb-5a72-4654-8712-ad9e026c5403 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:25:57.258814 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-26a461bb-5a72-4654-8712-ad9e026c5403 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:25:57.275053 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-26a461bb-5a72-4654-8712-ad9e026c5403 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:57.275503 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-26a461bb-5a72-4654-8712-ad9e026c5403 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:57.276299 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-26a461bb-5a72-4654-8712-ad9e026c5403 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:57.276728 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-26a461bb-5a72-4654-8712-ad9e026c5403 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:57.304686 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-26a461bb-5a72-4654-8712-ad9e026c5403 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Getting quotas for project cfa9219e414f4bd49dcbf215ed8d6f35. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:25:57.310209 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-26a461bb-5a72-4654-8712-ad9e026c5403 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Getting quotas for user 9cb6619f170a4a2295b89558706885bc and project cfa9219e414f4bd49dcbf215ed8d6f35. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:25:57.437060 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-26a461bb-5a72-4654-8712-ad9e026c5403 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:25:57.439794 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-26a461bb-5a72-4654-8712-ad9e026c5403 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2375b2d2-fca5-4c05-be72-9afcd49d7289',volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:25:57.654003 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-26a461bb-5a72-4654-8712-ad9e026c5403 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.087319 Oct 28 12:25:57.661770 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 730/1481] 10.222.0.37 () {60 vars in 1146 bytes} [Thu Oct 28 12:25:56 2021] POST /compute/v2.1/servers => generated 406 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:25:57.667448 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b8489ed0-c5d5-4630-b833-512dd57a158d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:57.668691 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b8489ed0-c5d5-4630-b833-512dd57a158d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:25:57.762318 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b8489ed0-c5d5-4630-b833-512dd57a158d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:25:57.782465 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b8489ed0-c5d5-4630-b833-512dd57a158d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1093 microversion: 2.1 time: 0.119522 Oct 28 12:25:57.783876 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 752/1482] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:25:57 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1093 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:25:58.801662 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-2e98029a-8479-4a36-a47e-edf7a3675b26 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:58.802330 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-2e98029a-8479-4a36-a47e-edf7a3675b26 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:25:58.810256 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2e98029a-8479-4a36-a47e-edf7a3675b26 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:58.811102 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2e98029a-8479-4a36-a47e-edf7a3675b26 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:58.812121 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2e98029a-8479-4a36-a47e-edf7a3675b26 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:58.812722 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-2e98029a-8479-4a36-a47e-edf7a3675b26 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:58.918053 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-2e98029a-8479-4a36-a47e-edf7a3675b26 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:25:58.930135 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-2e98029a-8479-4a36-a47e-edf7a3675b26 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1199 microversion: 2.1 time: 0.132851 Oct 28 12:25:58.931834 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 731/1483] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:25:58 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1199 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:25:59.223335 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:25:59.224007 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: Thu Oct 28 12:25:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:25:59.949184 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d55c6b99-c78f-4642-908a-50857db5310b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:25:59.949706 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d55c6b99-c78f-4642-908a-50857db5310b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:25:59.958338 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d55c6b99-c78f-4642-908a-50857db5310b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:59.959158 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d55c6b99-c78f-4642-908a-50857db5310b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:25:59.960138 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d55c6b99-c78f-4642-908a-50857db5310b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:25:59.960835 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d55c6b99-c78f-4642-908a-50857db5310b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:00.261046 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d55c6b99-c78f-4642-908a-50857db5310b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:00.269979 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d55c6b99-c78f-4642-908a-50857db5310b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.324948 Oct 28 12:26:00.271359 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 753/1484] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:25:59 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:00.736313 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-0edd9465-fdf2-4c1d-bd1c-be9a0bf86525 req-fb7e4608-683d-464e-855e-118640dbdac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd609dc2-6004-43aa-a771-b4c659a3d27e", "tag": "fee1be39-2573-4a6e-aa44-b3788989968b"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:26:00.737928 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:26:00.737928 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:26:00.748328 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-0edd9465-fdf2-4c1d-bd1c-be9a0bf86525 req-fb7e4608-683d-464e-855e-118640dbdac4 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:00.749178 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-0edd9465-fdf2-4c1d-bd1c-be9a0bf86525 req-fb7e4608-683d-464e-855e-118640dbdac4 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:00.766404 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-0edd9465-fdf2-4c1d-bd1c-be9a0bf86525 req-fb7e4608-683d-464e-855e-118640dbdac4 service nova] Creating event network-changed:fee1be39-2573-4a6e-aa44-b3788989968b for instance dd609dc2-6004-43aa-a771-b4c659a3d27e on hv-cinder-81571 Oct 28 12:26:00.790862 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-0edd9465-fdf2-4c1d-bd1c-be9a0bf86525 req-fb7e4608-683d-464e-855e-118640dbdac4 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058045 Oct 28 12:26:00.792189 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 732/1485] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:26:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:26:01.287623 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d4d8925a-884f-470c-923d-2e31adfd68c7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:01.288225 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-d4d8925a-884f-470c-923d-2e31adfd68c7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:01.298302 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d4d8925a-884f-470c-923d-2e31adfd68c7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:01.299132 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d4d8925a-884f-470c-923d-2e31adfd68c7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:01.300251 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d4d8925a-884f-470c-923d-2e31adfd68c7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:01.301367 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-d4d8925a-884f-470c-923d-2e31adfd68c7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:01.519671 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-d4d8925a-884f-470c-923d-2e31adfd68c7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:01.527767 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d4d8925a-884f-470c-923d-2e31adfd68c7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.244382 Oct 28 12:26:01.541788 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 754/1486] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:01 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:02.547124 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e818e3a0-df7a-44a4-82e4-b5d6a266e169 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:02.548526 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e818e3a0-df7a-44a4-82e4-b5d6a266e169 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:02.555861 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e818e3a0-df7a-44a4-82e4-b5d6a266e169 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:02.556531 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e818e3a0-df7a-44a4-82e4-b5d6a266e169 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:02.557497 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e818e3a0-df7a-44a4-82e4-b5d6a266e169 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:02.557964 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e818e3a0-df7a-44a4-82e4-b5d6a266e169 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:02.687653 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e818e3a0-df7a-44a4-82e4-b5d6a266e169 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:02.696455 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e818e3a0-df7a-44a4-82e4-b5d6a266e169 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.155425 Oct 28 12:26:02.697065 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 733/1487] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:02 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:02.814498 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-349437c8-5d08-49e9-aac9-c0d1b2cdbebd tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Action: 'create', calling method: .version_select at 0x7f11f823ea60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2042198690"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:26:02.832416 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-349437c8-5d08-49e9-aac9-c0d1b2cdbebd tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Getting quotas for project e50130a23a874c80924d4a3b729798ef. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:26:02.836101 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-349437c8-5d08-49e9-aac9-c0d1b2cdbebd tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Getting quotas for user 487e114a4fb942dbb1b14431012f0898 and project e50130a23a874c80924d4a3b729798ef. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:26:03.149898 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-349437c8-5d08-49e9-aac9-c0d1b2cdbebd tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Getting quotas for project e50130a23a874c80924d4a3b729798ef. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:26:03.153508 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.quota [None req-349437c8-5d08-49e9-aac9-c0d1b2cdbebd tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Getting quotas for user 487e114a4fb942dbb1b14431012f0898 and project e50130a23a874c80924d4a3b729798ef. Resources: {'key_pairs'} {{(pid=115798) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:26:03.167092 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-349437c8-5d08-49e9-aac9-c0d1b2cdbebd tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.356193 Oct 28 12:26:03.167686 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 755/1488] 10.222.0.37 () {60 vars in 1157 bytes} [Thu Oct 28 12:26:02 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:03.214883 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a21d4f45-b30e-4a1d-bc56-3b6d9041ffbc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2139229545", "imageRef": "78656c0f-2ba6-451a-9d6f-0d26b2074445", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2042198690", "networks": [{"uuid": "bf26eedc-9523-425a-a0db-af7aa6d28144"}]}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:26:03.263171 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.network.neutron [None req-a21d4f45-b30e-4a1d-bc56-3b6d9041ffbc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] validate_networks() for [('bf26eedc-9523-425a-a0db-af7aa6d28144', None, None, None, None, None)] {{(pid=115797) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 12:26:03.619041 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-a21d4f45-b30e-4a1d-bc56-3b6d9041ffbc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Flavor limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 12:26:03.619810 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-a21d4f45-b30e-4a1d-bc56-3b6d9041ffbc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Image limits 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 12:26:03.619971 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-a21d4f45-b30e-4a1d-bc56-3b6d9041ffbc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Flavor pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 12:26:03.620342 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-a21d4f45-b30e-4a1d-bc56-3b6d9041ffbc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Image pref 0:0:0 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 12:26:03.620779 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.virt.hardware [None req-a21d4f45-b30e-4a1d-bc56-3b6d9041ffbc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 12:26:03.631116 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a21d4f45-b30e-4a1d-bc56-3b6d9041ffbc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:03.631560 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a21d4f45-b30e-4a1d-bc56-3b6d9041ffbc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:03.632390 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a21d4f45-b30e-4a1d-bc56-3b6d9041ffbc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:03.632821 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a21d4f45-b30e-4a1d-bc56-3b6d9041ffbc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:03.653206 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-a21d4f45-b30e-4a1d-bc56-3b6d9041ffbc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Getting quotas for project e50130a23a874c80924d4a3b729798ef. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 12:26:03.657562 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.quota [None req-a21d4f45-b30e-4a1d-bc56-3b6d9041ffbc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Getting quotas for user 487e114a4fb942dbb1b14431012f0898 and project e50130a23a874c80924d4a3b729798ef. Resources: {'cores', 'instances', 'ram'} {{(pid=115797) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 12:26:03.668741 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a21d4f45-b30e-4a1d-bc56-3b6d9041ffbc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Going to run 1 instances... {{(pid=115797) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 12:26:03.671074 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a21d4f45-b30e-4a1d-bc56-3b6d9041ffbc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78656c0f-2ba6-451a-9d6f-0d26b2074445',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 12:26:03.716276 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f1716d78-6e6e-45f0-a488-17027ced14b8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:03.716894 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f1716d78-6e6e-45f0-a488-17027ced14b8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:03.717707 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a21d4f45-b30e-4a1d-bc56-3b6d9041ffbc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506341 Oct 28 12:26:03.722999 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 734/1489] 10.222.0.37 () {60 vars in 1146 bytes} [Thu Oct 28 12:26:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 12:26:03.724755 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f1716d78-6e6e-45f0-a488-17027ced14b8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:03.725211 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f1716d78-6e6e-45f0-a488-17027ced14b8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:03.726007 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f1716d78-6e6e-45f0-a488-17027ced14b8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:03.726424 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f1716d78-6e6e-45f0-a488-17027ced14b8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:03.727977 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f4a88ef6-e3cf-4ada-ae4f-25bf3a9fd8eb tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:03.728574 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f4a88ef6-e3cf-4ada-ae4f-25bf3a9fd8eb tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:03.788661 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f4a88ef6-e3cf-4ada-ae4f-25bf3a9fd8eb tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:03.795525 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f4a88ef6-e3cf-4ada-ae4f-25bf3a9fd8eb tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1259 microversion: 2.1 time: 0.071114 Oct 28 12:26:03.796181 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 735/1490] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:03 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:26:03.872746 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f1716d78-6e6e-45f0-a488-17027ced14b8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:03.882300 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f1716d78-6e6e-45f0-a488-17027ced14b8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.170400 Oct 28 12:26:03.886836 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 756/1491] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:03 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:04.812148 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c0e74cc8-d925-4edd-9fd1-b0eba1cca9f3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:04.812977 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c0e74cc8-d925-4edd-9fd1-b0eba1cca9f3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:04.819673 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0e74cc8-d925-4edd-9fd1-b0eba1cca9f3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:04.820123 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0e74cc8-d925-4edd-9fd1-b0eba1cca9f3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:04.820901 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0e74cc8-d925-4edd-9fd1-b0eba1cca9f3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:04.821332 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c0e74cc8-d925-4edd-9fd1-b0eba1cca9f3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:04.885580 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c0e74cc8-d925-4edd-9fd1-b0eba1cca9f3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:04.893459 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c0e74cc8-d925-4edd-9fd1-b0eba1cca9f3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1317 microversion: 2.1 time: 0.084935 Oct 28 12:26:04.903685 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 736/1492] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:04 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1317 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:04.904884 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-6be92de5-d2cc-497d-8043-dfe063f69f2c tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:04.904884 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-6be92de5-d2cc-497d-8043-dfe063f69f2c tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:04.912733 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6be92de5-d2cc-497d-8043-dfe063f69f2c tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:04.913192 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6be92de5-d2cc-497d-8043-dfe063f69f2c tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:04.913976 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6be92de5-d2cc-497d-8043-dfe063f69f2c tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:04.914410 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-6be92de5-d2cc-497d-8043-dfe063f69f2c tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:05.123118 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-6be92de5-d2cc-497d-8043-dfe063f69f2c tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:05.131420 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-6be92de5-d2cc-497d-8043-dfe063f69f2c tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.232713 Oct 28 12:26:05.137265 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 757/1493] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:04 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:05.911901 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-87bb1620-97b6-42d0-900b-82600bc27238 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:05.912499 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-87bb1620-97b6-42d0-900b-82600bc27238 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:05.919972 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-87bb1620-97b6-42d0-900b-82600bc27238 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:05.920657 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-87bb1620-97b6-42d0-900b-82600bc27238 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:05.921482 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-87bb1620-97b6-42d0-900b-82600bc27238 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:05.921870 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-87bb1620-97b6-42d0-900b-82600bc27238 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:06.049516 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-87bb1620-97b6-42d0-900b-82600bc27238 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:06.057955 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-87bb1620-97b6-42d0-900b-82600bc27238 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1359 microversion: 2.1 time: 0.150202 Oct 28 12:26:06.058614 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 737/1494] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:05 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:06.156570 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a8c12016-a5a6-42a2-b3ca-1fdd460c5eae tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:06.157277 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a8c12016-a5a6-42a2-b3ca-1fdd460c5eae tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:06.164288 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a8c12016-a5a6-42a2-b3ca-1fdd460c5eae tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:06.164736 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a8c12016-a5a6-42a2-b3ca-1fdd460c5eae tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:06.165615 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a8c12016-a5a6-42a2-b3ca-1fdd460c5eae tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:06.166084 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a8c12016-a5a6-42a2-b3ca-1fdd460c5eae tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:06.304822 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a8c12016-a5a6-42a2-b3ca-1fdd460c5eae tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:06.312221 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a8c12016-a5a6-42a2-b3ca-1fdd460c5eae tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.159264 Oct 28 12:26:06.312839 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 758/1495] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:06 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:07.074762 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3b16d05b-1747-43cb-9b82-1806b4f830c8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:07.075480 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3b16d05b-1747-43cb-9b82-1806b4f830c8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:07.082574 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3b16d05b-1747-43cb-9b82-1806b4f830c8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:07.083129 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3b16d05b-1747-43cb-9b82-1806b4f830c8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:07.083906 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3b16d05b-1747-43cb-9b82-1806b4f830c8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:07.084331 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3b16d05b-1747-43cb-9b82-1806b4f830c8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:07.208541 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3b16d05b-1747-43cb-9b82-1806b4f830c8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:07.216419 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3b16d05b-1747-43cb-9b82-1806b4f830c8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1359 microversion: 2.1 time: 0.145504 Oct 28 12:26:07.216990 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 738/1496] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:07 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:07.329094 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e7d793b9-3bf4-4d95-9b9f-6bbac5746075 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:07.329709 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e7d793b9-3bf4-4d95-9b9f-6bbac5746075 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:07.336699 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e7d793b9-3bf4-4d95-9b9f-6bbac5746075 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:07.337145 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e7d793b9-3bf4-4d95-9b9f-6bbac5746075 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:07.337986 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e7d793b9-3bf4-4d95-9b9f-6bbac5746075 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:07.338423 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e7d793b9-3bf4-4d95-9b9f-6bbac5746075 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:07.466079 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e7d793b9-3bf4-4d95-9b9f-6bbac5746075 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:07.474256 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e7d793b9-3bf4-4d95-9b9f-6bbac5746075 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.148820 Oct 28 12:26:07.474855 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 759/1497] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:07 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:08.233339 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0ccb3109-73e1-4940-bf9c-dda7d7783dc0 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:08.233944 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0ccb3109-73e1-4940-bf9c-dda7d7783dc0 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:08.240817 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0ccb3109-73e1-4940-bf9c-dda7d7783dc0 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:08.241352 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0ccb3109-73e1-4940-bf9c-dda7d7783dc0 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:08.242245 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0ccb3109-73e1-4940-bf9c-dda7d7783dc0 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:08.242786 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0ccb3109-73e1-4940-bf9c-dda7d7783dc0 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:08.378384 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0ccb3109-73e1-4940-bf9c-dda7d7783dc0 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:08.386446 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0ccb3109-73e1-4940-bf9c-dda7d7783dc0 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1359 microversion: 2.1 time: 0.156573 Oct 28 12:26:08.386916 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 739/1498] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:08 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:08.491516 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-50a8077d-1b0c-4b31-80a9-1046f201fef1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:08.492093 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-50a8077d-1b0c-4b31-80a9-1046f201fef1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:08.498349 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-50a8077d-1b0c-4b31-80a9-1046f201fef1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:08.498866 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-50a8077d-1b0c-4b31-80a9-1046f201fef1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:08.499670 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-50a8077d-1b0c-4b31-80a9-1046f201fef1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:08.500147 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-50a8077d-1b0c-4b31-80a9-1046f201fef1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:08.627674 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-50a8077d-1b0c-4b31-80a9-1046f201fef1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:08.635929 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-50a8077d-1b0c-4b31-80a9-1046f201fef1 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.148690 Oct 28 12:26:08.636506 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 760/1499] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:08 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:09.403084 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-90fc92a5-4cf3-4695-acb2-f6a8b477074a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:09.404296 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-90fc92a5-4cf3-4695-acb2-f6a8b477074a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:09.411557 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90fc92a5-4cf3-4695-acb2-f6a8b477074a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:09.412005 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90fc92a5-4cf3-4695-acb2-f6a8b477074a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:09.412788 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90fc92a5-4cf3-4695-acb2-f6a8b477074a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:09.413222 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-90fc92a5-4cf3-4695-acb2-f6a8b477074a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:09.538974 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-90fc92a5-4cf3-4695-acb2-f6a8b477074a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:09.546626 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-90fc92a5-4cf3-4695-acb2-f6a8b477074a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1359 microversion: 2.1 time: 0.147313 Oct 28 12:26:09.547387 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 740/1500] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:09 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:09.652719 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-65b6e930-265e-4ef4-8e91-31c4b4cf474b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:09.653464 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-65b6e930-265e-4ef4-8e91-31c4b4cf474b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:09.659643 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-65b6e930-265e-4ef4-8e91-31c4b4cf474b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:09.660463 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-65b6e930-265e-4ef4-8e91-31c4b4cf474b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:09.661182 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-65b6e930-265e-4ef4-8e91-31c4b4cf474b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:09.661613 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-65b6e930-265e-4ef4-8e91-31c4b4cf474b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:09.794327 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-65b6e930-265e-4ef4-8e91-31c4b4cf474b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:09.801937 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-65b6e930-265e-4ef4-8e91-31c4b4cf474b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.152932 Oct 28 12:26:09.802748 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 761/1501] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:09 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:10.563133 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-bf2cf565-52fb-434e-a44e-f3da0c9cdf75 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:10.563727 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-bf2cf565-52fb-434e-a44e-f3da0c9cdf75 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:10.570174 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf2cf565-52fb-434e-a44e-f3da0c9cdf75 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:10.570637 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf2cf565-52fb-434e-a44e-f3da0c9cdf75 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:10.571440 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf2cf565-52fb-434e-a44e-f3da0c9cdf75 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:10.571878 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-bf2cf565-52fb-434e-a44e-f3da0c9cdf75 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:10.694529 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-bf2cf565-52fb-434e-a44e-f3da0c9cdf75 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:10.701775 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-bf2cf565-52fb-434e-a44e-f3da0c9cdf75 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1359 microversion: 2.1 time: 0.142193 Oct 28 12:26:10.702334 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 741/1502] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:10 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1359 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:10.820542 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-171cb4bd-06ef-4d97-a6f3-5e2ae90fa435 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:10.821215 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-171cb4bd-06ef-4d97-a6f3-5e2ae90fa435 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:10.834929 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-171cb4bd-06ef-4d97-a6f3-5e2ae90fa435 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:10.835861 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-171cb4bd-06ef-4d97-a6f3-5e2ae90fa435 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:10.836766 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-171cb4bd-06ef-4d97-a6f3-5e2ae90fa435 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:10.837269 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-171cb4bd-06ef-4d97-a6f3-5e2ae90fa435 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:10.965479 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-171cb4bd-06ef-4d97-a6f3-5e2ae90fa435 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:10.973843 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-171cb4bd-06ef-4d97-a6f3-5e2ae90fa435 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.158834 Oct 28 12:26:10.974418 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 762/1503] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:10 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:11.719999 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-608f60ce-fab2-46ca-a78a-b1dc0e773fb8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:11.720625 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-608f60ce-fab2-46ca-a78a-b1dc0e773fb8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:11.728149 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-608f60ce-fab2-46ca-a78a-b1dc0e773fb8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:11.728601 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-608f60ce-fab2-46ca-a78a-b1dc0e773fb8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:11.729389 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-608f60ce-fab2-46ca-a78a-b1dc0e773fb8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:11.729826 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-608f60ce-fab2-46ca-a78a-b1dc0e773fb8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:11.859480 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-608f60ce-fab2-46ca-a78a-b1dc0e773fb8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:11.869595 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-608f60ce-fab2-46ca-a78a-b1dc0e773fb8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1359 microversion: 2.1 time: 0.153217 Oct 28 12:26:11.870384 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 742/1504] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:11 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:11.991194 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-913ba84b-301f-49ce-92c5-4057c1d47bc2 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:11.991786 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-913ba84b-301f-49ce-92c5-4057c1d47bc2 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:11.998176 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-913ba84b-301f-49ce-92c5-4057c1d47bc2 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:11.998623 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-913ba84b-301f-49ce-92c5-4057c1d47bc2 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:11.999508 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-913ba84b-301f-49ce-92c5-4057c1d47bc2 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:11.999940 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-913ba84b-301f-49ce-92c5-4057c1d47bc2 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:12.129156 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-913ba84b-301f-49ce-92c5-4057c1d47bc2 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:12.136851 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-913ba84b-301f-49ce-92c5-4057c1d47bc2 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.150105 Oct 28 12:26:12.137426 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 763/1505] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:11 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:26:12.887297 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ac072b09-24f3-4651-8da1-12b02d9f623e tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:12.888081 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ac072b09-24f3-4651-8da1-12b02d9f623e tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:12.894663 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac072b09-24f3-4651-8da1-12b02d9f623e tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:12.895134 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac072b09-24f3-4651-8da1-12b02d9f623e tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:12.895940 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac072b09-24f3-4651-8da1-12b02d9f623e tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:12.896369 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ac072b09-24f3-4651-8da1-12b02d9f623e tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:13.027444 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ac072b09-24f3-4651-8da1-12b02d9f623e tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:13.035179 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ac072b09-24f3-4651-8da1-12b02d9f623e tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1359 microversion: 2.1 time: 0.151762 Oct 28 12:26:13.035752 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 743/1506] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:12 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:13.154635 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-56a1c1b5-2d8e-4dd9-98f7-ca37c14b5004 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:13.155533 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-56a1c1b5-2d8e-4dd9-98f7-ca37c14b5004 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:13.161795 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-56a1c1b5-2d8e-4dd9-98f7-ca37c14b5004 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:13.162241 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-56a1c1b5-2d8e-4dd9-98f7-ca37c14b5004 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:13.163064 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-56a1c1b5-2d8e-4dd9-98f7-ca37c14b5004 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:13.163495 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-56a1c1b5-2d8e-4dd9-98f7-ca37c14b5004 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:13.290343 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-56a1c1b5-2d8e-4dd9-98f7-ca37c14b5004 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:13.298406 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-56a1c1b5-2d8e-4dd9-98f7-ca37c14b5004 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.147291 Oct 28 12:26:13.299025 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 764/1507] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:13 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:14.052849 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-12642f6b-2f7c-4dd8-b8fd-c47b9f98adef tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:14.053563 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-12642f6b-2f7c-4dd8-b8fd-c47b9f98adef tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:14.059999 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-12642f6b-2f7c-4dd8-b8fd-c47b9f98adef tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:14.060454 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-12642f6b-2f7c-4dd8-b8fd-c47b9f98adef tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:14.061227 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-12642f6b-2f7c-4dd8-b8fd-c47b9f98adef tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:14.061656 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-12642f6b-2f7c-4dd8-b8fd-c47b9f98adef tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:14.190215 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-12642f6b-2f7c-4dd8-b8fd-c47b9f98adef tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:14.198266 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-12642f6b-2f7c-4dd8-b8fd-c47b9f98adef tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1359 microversion: 2.1 time: 0.149738 Oct 28 12:26:14.198906 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 744/1508] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:14 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:14.314122 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-611c4b5e-6ee3-4b9d-b4bf-e9532d43a4a9 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:14.314777 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-611c4b5e-6ee3-4b9d-b4bf-e9532d43a4a9 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:14.321039 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-611c4b5e-6ee3-4b9d-b4bf-e9532d43a4a9 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:14.321483 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-611c4b5e-6ee3-4b9d-b4bf-e9532d43a4a9 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:14.322246 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-611c4b5e-6ee3-4b9d-b4bf-e9532d43a4a9 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:14.322693 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-611c4b5e-6ee3-4b9d-b4bf-e9532d43a4a9 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:14.448402 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-611c4b5e-6ee3-4b9d-b4bf-e9532d43a4a9 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:14.456510 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-611c4b5e-6ee3-4b9d-b4bf-e9532d43a4a9 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.145948 Oct 28 12:26:14.457589 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 765/1509] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:14 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:15.215666 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e654d8a4-944d-4bea-86aa-1354d9322709 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:15.216254 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e654d8a4-944d-4bea-86aa-1354d9322709 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:15.222568 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e654d8a4-944d-4bea-86aa-1354d9322709 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:15.223044 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e654d8a4-944d-4bea-86aa-1354d9322709 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:15.223829 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e654d8a4-944d-4bea-86aa-1354d9322709 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:15.224260 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e654d8a4-944d-4bea-86aa-1354d9322709 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:15.352288 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e654d8a4-944d-4bea-86aa-1354d9322709 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:15.360016 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e654d8a4-944d-4bea-86aa-1354d9322709 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1359 microversion: 2.1 time: 0.147992 Oct 28 12:26:15.360577 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 745/1510] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:15 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:15.473438 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-157479c8-d962-4462-a743-641a64410c00 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:15.474041 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-157479c8-d962-4462-a743-641a64410c00 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:15.480514 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-157479c8-d962-4462-a743-641a64410c00 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:15.480930 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-157479c8-d962-4462-a743-641a64410c00 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:15.481682 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-157479c8-d962-4462-a743-641a64410c00 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:15.482105 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-157479c8-d962-4462-a743-641a64410c00 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:15.617133 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-157479c8-d962-4462-a743-641a64410c00 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:15.627964 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-157479c8-d962-4462-a743-641a64410c00 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.158606 Oct 28 12:26:15.628724 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 766/1511] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:15 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:16.377128 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5990f665-5435-46e7-a315-9653d2dd01dc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:16.377711 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5990f665-5435-46e7-a315-9653d2dd01dc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:16.384505 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5990f665-5435-46e7-a315-9653d2dd01dc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:16.384943 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5990f665-5435-46e7-a315-9653d2dd01dc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:16.385696 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5990f665-5435-46e7-a315-9653d2dd01dc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:16.386117 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5990f665-5435-46e7-a315-9653d2dd01dc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:16.504406 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5990f665-5435-46e7-a315-9653d2dd01dc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:16.511604 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5990f665-5435-46e7-a315-9653d2dd01dc tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1359 microversion: 2.1 time: 0.138310 Oct 28 12:26:16.512162 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 746/1512] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:16 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1359 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:16.644902 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-88e4ed96-ec9e-48f0-839a-f2673e1fdd8d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:16.646126 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-88e4ed96-ec9e-48f0-839a-f2673e1fdd8d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:16.652871 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-88e4ed96-ec9e-48f0-839a-f2673e1fdd8d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:16.653314 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-88e4ed96-ec9e-48f0-839a-f2673e1fdd8d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:16.654077 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-88e4ed96-ec9e-48f0-839a-f2673e1fdd8d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:16.654502 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-88e4ed96-ec9e-48f0-839a-f2673e1fdd8d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:16.775609 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-88e4ed96-ec9e-48f0-839a-f2673e1fdd8d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:16.782881 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-88e4ed96-ec9e-48f0-839a-f2673e1fdd8d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.141718 Oct 28 12:26:16.783499 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 767/1513] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:16 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:17.528267 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4706daa8-8634-46f9-9585-5f488ed8e937 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:17.528848 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4706daa8-8634-46f9-9585-5f488ed8e937 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:17.535274 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4706daa8-8634-46f9-9585-5f488ed8e937 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:17.535713 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4706daa8-8634-46f9-9585-5f488ed8e937 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:17.536953 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4706daa8-8634-46f9-9585-5f488ed8e937 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:17.537381 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4706daa8-8634-46f9-9585-5f488ed8e937 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:17.656303 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4706daa8-8634-46f9-9585-5f488ed8e937 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:17.663724 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4706daa8-8634-46f9-9585-5f488ed8e937 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1359 microversion: 2.1 time: 0.139127 Oct 28 12:26:17.664281 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 747/1514] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:17 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1359 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:17.800011 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-ad9b7fa9-77a2-4271-a5d2-8c8f253807d0 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:17.800577 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-ad9b7fa9-77a2-4271-a5d2-8c8f253807d0 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:17.807597 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad9b7fa9-77a2-4271-a5d2-8c8f253807d0 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:17.808038 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad9b7fa9-77a2-4271-a5d2-8c8f253807d0 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:17.808828 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad9b7fa9-77a2-4271-a5d2-8c8f253807d0 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:17.809257 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-ad9b7fa9-77a2-4271-a5d2-8c8f253807d0 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:18.011891 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-ad9b7fa9-77a2-4271-a5d2-8c8f253807d0 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:18.019406 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-ad9b7fa9-77a2-4271-a5d2-8c8f253807d0 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.223204 Oct 28 12:26:18.019989 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 768/1515] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:17 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:26:18.525049 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-ad1ef314-1389-4a2b-817d-9011d49a8015 req-ad22edc8-475c-47cf-a733-51916cd0c993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b", "tag": "6791e60c-7f12-447e-910f-5ce7bf610d10"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:26:18.526835 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:26:18.526835 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:26:18.539017 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-ad1ef314-1389-4a2b-817d-9011d49a8015 req-ad22edc8-475c-47cf-a733-51916cd0c993 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:18.539587 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-ad1ef314-1389-4a2b-817d-9011d49a8015 req-ad22edc8-475c-47cf-a733-51916cd0c993 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:18.551334 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-ad1ef314-1389-4a2b-817d-9011d49a8015 req-ad22edc8-475c-47cf-a733-51916cd0c993 service nova] Creating event network-changed:6791e60c-7f12-447e-910f-5ce7bf610d10 for instance e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b on hv-cinder-81571 Oct 28 12:26:18.556554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-ad1ef314-1389-4a2b-817d-9011d49a8015 req-ad22edc8-475c-47cf-a733-51916cd0c993 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041569 Oct 28 12:26:18.557478 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 748/1516] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:26:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:26:18.683793 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-82660978-0fa7-4fe6-a2fc-3d1229737501 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:18.684566 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-82660978-0fa7-4fe6-a2fc-3d1229737501 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:18.690893 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-82660978-0fa7-4fe6-a2fc-3d1229737501 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:18.691405 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-82660978-0fa7-4fe6-a2fc-3d1229737501 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:18.692809 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-82660978-0fa7-4fe6-a2fc-3d1229737501 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:18.693308 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-82660978-0fa7-4fe6-a2fc-3d1229737501 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:18.897630 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-82660978-0fa7-4fe6-a2fc-3d1229737501 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:18.904919 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-82660978-0fa7-4fe6-a2fc-3d1229737501 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1359 microversion: 2.1 time: 0.227049 Oct 28 12:26:18.905778 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 769/1517] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:18 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:19.039386 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-7939a2c0-1e34-4647-8129-a1397547a975 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:19.040093 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-7939a2c0-1e34-4647-8129-a1397547a975 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:19.046829 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7939a2c0-1e34-4647-8129-a1397547a975 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:19.047390 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7939a2c0-1e34-4647-8129-a1397547a975 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:19.048179 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7939a2c0-1e34-4647-8129-a1397547a975 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:19.048612 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-7939a2c0-1e34-4647-8129-a1397547a975 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:19.174462 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-7939a2c0-1e34-4647-8129-a1397547a975 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:19.182318 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-7939a2c0-1e34-4647-8129-a1397547a975 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.149503 Oct 28 12:26:19.183016 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 749/1518] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:19 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:19.921680 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-65b24ce0-7ba1-4ae9-838c-4aeab9614e3a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:19.922372 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-65b24ce0-7ba1-4ae9-838c-4aeab9614e3a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:19.929402 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-65b24ce0-7ba1-4ae9-838c-4aeab9614e3a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:19.929839 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-65b24ce0-7ba1-4ae9-838c-4aeab9614e3a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:19.930598 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-65b24ce0-7ba1-4ae9-838c-4aeab9614e3a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:19.931059 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-65b24ce0-7ba1-4ae9-838c-4aeab9614e3a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:20.062912 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-65b24ce0-7ba1-4ae9-838c-4aeab9614e3a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:20.070489 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-65b24ce0-7ba1-4ae9-838c-4aeab9614e3a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1359 microversion: 2.1 time: 0.152388 Oct 28 12:26:20.071104 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 770/1519] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:19 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:26:20.200978 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-50e4bc6e-3b75-48bd-a1de-d481f058e547 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:20.201771 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-50e4bc6e-3b75-48bd-a1de-d481f058e547 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:20.208645 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50e4bc6e-3b75-48bd-a1de-d481f058e547 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:20.209077 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50e4bc6e-3b75-48bd-a1de-d481f058e547 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:20.209854 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50e4bc6e-3b75-48bd-a1de-d481f058e547 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:20.210277 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-50e4bc6e-3b75-48bd-a1de-d481f058e547 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:20.336492 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-50e4bc6e-3b75-48bd-a1de-d481f058e547 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:20.344008 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-50e4bc6e-3b75-48bd-a1de-d481f058e547 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.147801 Oct 28 12:26:20.345287 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 750/1520] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:20 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:26:21.087798 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a70e0985-49ed-4e5e-b17c-c78e74d0af4c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:21.088407 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a70e0985-49ed-4e5e-b17c-c78e74d0af4c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:21.094709 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a70e0985-49ed-4e5e-b17c-c78e74d0af4c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:21.095167 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a70e0985-49ed-4e5e-b17c-c78e74d0af4c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:21.095924 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a70e0985-49ed-4e5e-b17c-c78e74d0af4c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:21.096349 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a70e0985-49ed-4e5e-b17c-c78e74d0af4c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:21.222950 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-a70e0985-49ed-4e5e-b17c-c78e74d0af4c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:21.230223 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a70e0985-49ed-4e5e-b17c-c78e74d0af4c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1359 microversion: 2.1 time: 0.146019 Oct 28 12:26:21.231017 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 771/1521] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:21 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:21.362105 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-f6b1f1ce-06e3-4761-8e5b-c18eab449bd4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:21.362739 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-f6b1f1ce-06e3-4761-8e5b-c18eab449bd4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:21.369069 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6b1f1ce-06e3-4761-8e5b-c18eab449bd4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:21.369530 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6b1f1ce-06e3-4761-8e5b-c18eab449bd4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:21.370319 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6b1f1ce-06e3-4761-8e5b-c18eab449bd4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:21.370868 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-f6b1f1ce-06e3-4761-8e5b-c18eab449bd4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:21.498343 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-f6b1f1ce-06e3-4761-8e5b-c18eab449bd4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:21.506743 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-f6b1f1ce-06e3-4761-8e5b-c18eab449bd4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.148297 Oct 28 12:26:21.507323 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 751/1522] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:21 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:22.246464 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-212258a3-c472-4955-8c80-b988d6a9b6f6 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:22.247081 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-212258a3-c472-4955-8c80-b988d6a9b6f6 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:22.253304 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-212258a3-c472-4955-8c80-b988d6a9b6f6 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:22.253738 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-212258a3-c472-4955-8c80-b988d6a9b6f6 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:22.254564 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-212258a3-c472-4955-8c80-b988d6a9b6f6 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:22.255045 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-212258a3-c472-4955-8c80-b988d6a9b6f6 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:22.374184 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-212258a3-c472-4955-8c80-b988d6a9b6f6 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:22.382578 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-212258a3-c472-4955-8c80-b988d6a9b6f6 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1359 microversion: 2.1 time: 0.139678 Oct 28 12:26:22.383187 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 772/1523] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:22 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1359 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:22.524477 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-1a93e98c-3486-44c9-bce6-508189e3208c tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:22.525023 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-1a93e98c-3486-44c9-bce6-508189e3208c tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:22.534009 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a93e98c-3486-44c9-bce6-508189e3208c tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:22.534883 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a93e98c-3486-44c9-bce6-508189e3208c tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:22.535878 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a93e98c-3486-44c9-bce6-508189e3208c tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:22.536312 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-1a93e98c-3486-44c9-bce6-508189e3208c tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:22.667738 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-1a93e98c-3486-44c9-bce6-508189e3208c tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:22.675328 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-1a93e98c-3486-44c9-bce6-508189e3208c tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.155387 Oct 28 12:26:22.675911 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 752/1524] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:22 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:23.398668 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-7d2afa5f-740f-4f7b-9a02-ec5c3161c60e tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:23.399307 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-7d2afa5f-740f-4f7b-9a02-ec5c3161c60e tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:23.405411 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d2afa5f-740f-4f7b-9a02-ec5c3161c60e tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:23.406080 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d2afa5f-740f-4f7b-9a02-ec5c3161c60e tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:23.407091 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d2afa5f-740f-4f7b-9a02-ec5c3161c60e tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:23.407525 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-7d2afa5f-740f-4f7b-9a02-ec5c3161c60e tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:23.530941 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-7d2afa5f-740f-4f7b-9a02-ec5c3161c60e tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:23.539728 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-7d2afa5f-740f-4f7b-9a02-ec5c3161c60e tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1359 microversion: 2.1 time: 0.144365 Oct 28 12:26:23.540493 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 773/1525] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:23 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:23.556526 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-59a555e2-2a1c-49fd-a69d-e98d4ae52ddb req-f550fbc5-e801-4be3-85e8-5191488e3412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd609dc2-6004-43aa-a771-b4c659a3d27e", "name": "network-vif-plugged", "status": "completed", "tag": "fee1be39-2573-4a6e-aa44-b3788989968b"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:26:23.559958 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:26:23.559958 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:26:23.568687 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-59a555e2-2a1c-49fd-a69d-e98d4ae52ddb req-f550fbc5-e801-4be3-85e8-5191488e3412 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:23.569277 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-59a555e2-2a1c-49fd-a69d-e98d4ae52ddb req-f550fbc5-e801-4be3-85e8-5191488e3412 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:23.582087 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-59a555e2-2a1c-49fd-a69d-e98d4ae52ddb req-f550fbc5-e801-4be3-85e8-5191488e3412 service nova] Creating event network-vif-plugged:fee1be39-2573-4a6e-aa44-b3788989968b for instance dd609dc2-6004-43aa-a771-b4c659a3d27e on hv-cinder-81571 Oct 28 12:26:23.587891 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-59a555e2-2a1c-49fd-a69d-e98d4ae52ddb req-f550fbc5-e801-4be3-85e8-5191488e3412 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034727 Oct 28 12:26:23.588650 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 753/1526] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:26:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:26:23.693564 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-2ba5bb2e-fcd5-4647-983b-dec1f0a5177d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:23.694194 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-2ba5bb2e-fcd5-4647-983b-dec1f0a5177d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:23.700610 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2ba5bb2e-fcd5-4647-983b-dec1f0a5177d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:23.701052 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2ba5bb2e-fcd5-4647-983b-dec1f0a5177d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:23.701984 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2ba5bb2e-fcd5-4647-983b-dec1f0a5177d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:23.702437 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-2ba5bb2e-fcd5-4647-983b-dec1f0a5177d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:23.873744 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-2ba5bb2e-fcd5-4647-983b-dec1f0a5177d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:23.881179 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-2ba5bb2e-fcd5-4647-983b-dec1f0a5177d tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.191311 Oct 28 12:26:23.882023 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 774/1527] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:23 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:24.558182 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-75c1f344-43b7-4de6-b970-88d8ebbf3d1a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:24.558916 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-75c1f344-43b7-4de6-b970-88d8ebbf3d1a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:24.565066 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-75c1f344-43b7-4de6-b970-88d8ebbf3d1a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:24.565507 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-75c1f344-43b7-4de6-b970-88d8ebbf3d1a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:24.566275 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-75c1f344-43b7-4de6-b970-88d8ebbf3d1a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:24.566727 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-75c1f344-43b7-4de6-b970-88d8ebbf3d1a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:24.695821 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-75c1f344-43b7-4de6-b970-88d8ebbf3d1a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:24.703261 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-75c1f344-43b7-4de6-b970-88d8ebbf3d1a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1359 microversion: 2.1 time: 0.149112 Oct 28 12:26:24.703836 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 754/1528] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:24 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:24.898142 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e2ed081d-744e-4922-b806-d560dbe356dc tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:24.898821 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e2ed081d-744e-4922-b806-d560dbe356dc tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:24.905047 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e2ed081d-744e-4922-b806-d560dbe356dc tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:24.905487 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e2ed081d-744e-4922-b806-d560dbe356dc tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:24.906257 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e2ed081d-744e-4922-b806-d560dbe356dc tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:24.906697 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e2ed081d-744e-4922-b806-d560dbe356dc tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:25.043903 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e2ed081d-744e-4922-b806-d560dbe356dc tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:25.052542 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e2ed081d-744e-4922-b806-d560dbe356dc tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1265 microversion: 2.1 time: 0.158173 Oct 28 12:26:25.053119 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 775/1529] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:24 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:25.605058 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-3d852be3-329f-4693-996c-285d393a4cd9 req-7ae6962f-658e-43d1-97e8-ffbdc6aefdaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b", "name": "network-vif-plugged", "status": "completed", "tag": "6791e60c-7f12-447e-910f-5ce7bf610d10"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:26:25.606591 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:26:25.606591 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:26:25.614186 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-3d852be3-329f-4693-996c-285d393a4cd9 req-7ae6962f-658e-43d1-97e8-ffbdc6aefdaf service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:25.614623 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-3d852be3-329f-4693-996c-285d393a4cd9 req-7ae6962f-658e-43d1-97e8-ffbdc6aefdaf service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:25.624992 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-3d852be3-329f-4693-996c-285d393a4cd9 req-7ae6962f-658e-43d1-97e8-ffbdc6aefdaf service nova] Creating event network-vif-plugged:6791e60c-7f12-447e-910f-5ce7bf610d10 for instance e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b on hv-cinder-81571 Oct 28 12:26:25.630652 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-3d852be3-329f-4693-996c-285d393a4cd9 req-7ae6962f-658e-43d1-97e8-ffbdc6aefdaf service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029195 Oct 28 12:26:25.631326 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 755/1530] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:26:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:26:25.723876 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-be8c28d1-1ad8-4be6-8ac9-c3d7b26ff93f tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:25.729245 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-be8c28d1-1ad8-4be6-8ac9-c3d7b26ff93f tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:25.743820 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-be8c28d1-1ad8-4be6-8ac9-c3d7b26ff93f tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:25.744266 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-be8c28d1-1ad8-4be6-8ac9-c3d7b26ff93f tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:25.745049 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-be8c28d1-1ad8-4be6-8ac9-c3d7b26ff93f tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:25.745483 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-be8c28d1-1ad8-4be6-8ac9-c3d7b26ff93f tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:25.956896 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-be8c28d1-1ad8-4be6-8ac9-c3d7b26ff93f tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:25.965404 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-be8c28d1-1ad8-4be6-8ac9-c3d7b26ff93f tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1359 microversion: 2.1 time: 0.248307 Oct 28 12:26:25.965980 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 776/1531] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:25 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1359 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:26.072499 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4c4a11fa-97ab-4032-9d5e-5770b4344f2a tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:26.073191 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4c4a11fa-97ab-4032-9d5e-5770b4344f2a tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:26.079336 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4c4a11fa-97ab-4032-9d5e-5770b4344f2a tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:26.079787 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4c4a11fa-97ab-4032-9d5e-5770b4344f2a tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:26.080555 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4c4a11fa-97ab-4032-9d5e-5770b4344f2a tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:26.080994 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4c4a11fa-97ab-4032-9d5e-5770b4344f2a tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:26.204590 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4c4a11fa-97ab-4032-9d5e-5770b4344f2a tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:26.212118 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4c4a11fa-97ab-4032-9d5e-5770b4344f2a tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1452 microversion: 2.1 time: 0.143619 Oct 28 12:26:26.212707 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 756/1532] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:26 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1452 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:26.227782 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-da24a696-ff16-4d19-b6cf-49eae6c015f7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:26.228379 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-da24a696-ff16-4d19-b6cf-49eae6c015f7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:26.234372 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da24a696-ff16-4d19-b6cf-49eae6c015f7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:26.235663 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da24a696-ff16-4d19-b6cf-49eae6c015f7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:26.237531 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da24a696-ff16-4d19-b6cf-49eae6c015f7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:26.237958 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-da24a696-ff16-4d19-b6cf-49eae6c015f7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:26.361611 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-da24a696-ff16-4d19-b6cf-49eae6c015f7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:26.369694 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-da24a696-ff16-4d19-b6cf-49eae6c015f7 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1452 microversion: 2.1 time: 0.145546 Oct 28 12:26:26.370261 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 777/1533] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:26 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1452 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:26.982113 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3fce9815-85b3-4b95-8093-b0f7a85cacab tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:26.983506 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3fce9815-85b3-4b95-8093-b0f7a85cacab tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:26.991309 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3fce9815-85b3-4b95-8093-b0f7a85cacab tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:26.991758 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3fce9815-85b3-4b95-8093-b0f7a85cacab tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:26.992541 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3fce9815-85b3-4b95-8093-b0f7a85cacab tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:26.992976 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3fce9815-85b3-4b95-8093-b0f7a85cacab tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:27.405035 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-3fce9815-85b3-4b95-8093-b0f7a85cacab tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:27.412920 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3fce9815-85b3-4b95-8093-b0f7a85cacab tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1359 microversion: 2.1 time: 0.434498 Oct 28 12:26:27.413941 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 757/1534] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:26 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1359 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:28.433298 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8fb33748-90d4-433c-8e6e-5d2d847dc6da tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:28.434394 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8fb33748-90d4-433c-8e6e-5d2d847dc6da tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:28.445702 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8fb33748-90d4-433c-8e6e-5d2d847dc6da tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:28.445702 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8fb33748-90d4-433c-8e6e-5d2d847dc6da tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:28.446654 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8fb33748-90d4-433c-8e6e-5d2d847dc6da tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:28.447111 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8fb33748-90d4-433c-8e6e-5d2d847dc6da tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:28.506118 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-e788d57b-ebfe-409b-9f0b-d54a30253ef5 req-38f3ab3d-3561-439b-bf9c-8eb63b4dcec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd609dc2-6004-43aa-a771-b4c659a3d27e", "tag": "fee1be39-2573-4a6e-aa44-b3788989968b"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:26:28.507654 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:26:28.507654 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:26:28.515478 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-e788d57b-ebfe-409b-9f0b-d54a30253ef5 req-38f3ab3d-3561-439b-bf9c-8eb63b4dcec5 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:28.516325 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-e788d57b-ebfe-409b-9f0b-d54a30253ef5 req-38f3ab3d-3561-439b-bf9c-8eb63b4dcec5 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:28.527998 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-e788d57b-ebfe-409b-9f0b-d54a30253ef5 req-38f3ab3d-3561-439b-bf9c-8eb63b4dcec5 service nova] Creating event network-changed:fee1be39-2573-4a6e-aa44-b3788989968b for instance dd609dc2-6004-43aa-a771-b4c659a3d27e on hv-cinder-81571 Oct 28 12:26:28.533266 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-e788d57b-ebfe-409b-9f0b-d54a30253ef5 req-38f3ab3d-3561-439b-bf9c-8eb63b4dcec5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031218 Oct 28 12:26:28.533826 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 758/1535] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:26:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:26:28.635666 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8fb33748-90d4-433c-8e6e-5d2d847dc6da tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:28.643407 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8fb33748-90d4-433c-8e6e-5d2d847dc6da tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1549 microversion: 2.1 time: 0.217484 Oct 28 12:26:28.643998 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 778/1536] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:28 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1549 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:28.661176 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e1f0e825-8099-405a-8270-3315e36141b3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:28.662004 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e1f0e825-8099-405a-8270-3315e36141b3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:28.669108 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e1f0e825-8099-405a-8270-3315e36141b3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:28.669699 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e1f0e825-8099-405a-8270-3315e36141b3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:28.670799 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e1f0e825-8099-405a-8270-3315e36141b3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:28.671309 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e1f0e825-8099-405a-8270-3315e36141b3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:28.803516 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e1f0e825-8099-405a-8270-3315e36141b3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:28.811894 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e1f0e825-8099-405a-8270-3315e36141b3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1549 microversion: 2.1 time: 0.155365 Oct 28 12:26:28.812522 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 759/1537] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:28 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:28.827429 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-72c00df4-dedd-40a7-8f62-4ac041f82749 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:28.830845 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:26:28.830845 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:26:28.832051 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-72c00df4-dedd-40a7-8f62-4ac041f82749 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:28.832763 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-72c00df4-dedd-40a7-8f62-4ac041f82749 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Searching by: {'deleted': False, 'project_id': 'e50130a23a874c80924d4a3b729798ef'} {{(pid=115798) get_all /opt/stack/nova/nova/compute/api.py:2905}} Oct 28 12:26:28.839546 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72c00df4-dedd-40a7-8f62-4ac041f82749 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:28.840224 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72c00df4-dedd-40a7-8f62-4ac041f82749 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:28.841437 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72c00df4-dedd-40a7-8f62-4ac041f82749 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:28.842043 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-72c00df4-dedd-40a7-8f62-4ac041f82749 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:28.942272 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.multi_cell_list [None req-72c00df4-dedd-40a7-8f62-4ac041f82749 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=115798) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Oct 28 12:26:29.039670 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-72c00df4-dedd-40a7-8f62-4ac041f82749 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.215808 Oct 28 12:26:29.040274 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 779/1538] 10.222.0.37 () {58 vars in 1124 bytes} [Thu Oct 28 12:26:28 2021] GET /compute/v2.1/servers => generated 343 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:26:29.050588 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-c166ca1c-495e-4111-8ca2-17ce5a7d7f0d tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:29.051234 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-c166ca1c-495e-4111-8ca2-17ce5a7d7f0d tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:29.057216 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c166ca1c-495e-4111-8ca2-17ce5a7d7f0d tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:29.057668 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c166ca1c-495e-4111-8ca2-17ce5a7d7f0d tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:29.058445 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c166ca1c-495e-4111-8ca2-17ce5a7d7f0d tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:29.058902 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-c166ca1c-495e-4111-8ca2-17ce5a7d7f0d tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:29.199721 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-c166ca1c-495e-4111-8ca2-17ce5a7d7f0d tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:29.208244 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-c166ca1c-495e-4111-8ca2-17ce5a7d7f0d tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1549 microversion: 2.1 time: 0.160926 Oct 28 12:26:29.208930 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 760/1539] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:29 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:30.727397 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-44813490-fc0b-499c-904a-38bdc996027d tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09c1c979-0d24-4ead-b674-6826707ff685"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:26:30.728450 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-44813490-fc0b-499c-904a-38bdc996027d tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:30.734803 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44813490-fc0b-499c-904a-38bdc996027d tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:30.735256 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44813490-fc0b-499c-904a-38bdc996027d tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:30.736031 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44813490-fc0b-499c-904a-38bdc996027d tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:30.736466 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-44813490-fc0b-499c-904a-38bdc996027d tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:30.963836 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-44813490-fc0b-499c-904a-38bdc996027d tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "POST /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240839 Oct 28 12:26:30.964437 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 780/1540] 10.222.0.37 () {60 vars in 1322 bytes} [Thu Oct 28 12:26:30 2021] POST /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:26:38.480998 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a2f34653-c70d-4495-8329-17f5eda599d9 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:38.481601 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a2f34653-c70d-4495-8329-17f5eda599d9 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:38.487877 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a2f34653-c70d-4495-8329-17f5eda599d9 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:38.488321 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a2f34653-c70d-4495-8329-17f5eda599d9 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:38.489801 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a2f34653-c70d-4495-8329-17f5eda599d9 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:38.490227 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a2f34653-c70d-4495-8329-17f5eda599d9 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:38.610486 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-a2f34653-c70d-4495-8329-17f5eda599d9 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:38.618640 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a2f34653-c70d-4495-8329-17f5eda599d9 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1595 microversion: 2.1 time: 0.141235 Oct 28 12:26:38.619240 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 761/1541] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:38 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1595 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:26:40.401085 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-d2397c2f-8394-4e0c-9885-10c57494a80e req-06a39c08-d6ef-4433-b419-d3f6230b20a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b", "tag": "6791e60c-7f12-447e-910f-5ce7bf610d10"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:26:40.402886 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:26:40.402886 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:26:40.412077 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-d2397c2f-8394-4e0c-9885-10c57494a80e req-06a39c08-d6ef-4433-b419-d3f6230b20a0 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:40.412512 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-d2397c2f-8394-4e0c-9885-10c57494a80e req-06a39c08-d6ef-4433-b419-d3f6230b20a0 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:40.424608 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-d2397c2f-8394-4e0c-9885-10c57494a80e req-06a39c08-d6ef-4433-b419-d3f6230b20a0 service nova] Creating event network-changed:6791e60c-7f12-447e-910f-5ce7bf610d10 for instance e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b on hv-cinder-81571 Oct 28 12:26:40.430270 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-d2397c2f-8394-4e0c-9885-10c57494a80e req-06a39c08-d6ef-4433-b419-d3f6230b20a0 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198977 Oct 28 12:26:40.430946 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 781/1542] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:26:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:26:41.259794 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-94d12909-c2af-4d3f-b20c-4cc95dffb410 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1988616771"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:26:41.260333 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-94d12909-c2af-4d3f-b20c-4cc95dffb410 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:41.267063 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94d12909-c2af-4d3f-b20c-4cc95dffb410 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:41.267681 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94d12909-c2af-4d3f-b20c-4cc95dffb410 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:41.268500 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94d12909-c2af-4d3f-b20c-4cc95dffb410 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:41.269019 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-94d12909-c2af-4d3f-b20c-4cc95dffb410 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:41.390636 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.network.security_group_api [None req-94d12909-c2af-4d3f-b20c-4cc95dffb410 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Adding security group 21434db0-0a82-4316-9754-f480353ae6be to port 6791e60c-7f12-447e-910f-5ce7bf610d10 Oct 28 12:26:41.737286 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-94d12909-c2af-4d3f-b20c-4cc95dffb410 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "POST /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b/action" status: 202 len: 0 microversion: 2.1 time: 0.481248 Oct 28 12:26:41.742411 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 762/1543] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:26:41 2021] POST /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:26:41.747685 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5736882f-d96b-4bb3-8279-a38f79c3bf96 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:26:41.748905 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-5736882f-d96b-4bb3-8279-a38f79c3bf96 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:26:41.755777 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5736882f-d96b-4bb3-8279-a38f79c3bf96 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:41.756670 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5736882f-d96b-4bb3-8279-a38f79c3bf96 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:41.757809 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5736882f-d96b-4bb3-8279-a38f79c3bf96 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:41.758406 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-5736882f-d96b-4bb3-8279-a38f79c3bf96 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:41.905278 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-5736882f-d96b-4bb3-8279-a38f79c3bf96 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:26:41.918324 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5736882f-d96b-4bb3-8279-a38f79c3bf96 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1760 microversion: 2.1 time: 0.175163 Oct 28 12:26:41.919248 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 782/1544] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:26:41 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1760 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:26:42.445210 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-7b58edd0-14f3-423b-8e2d-e9bd02907a5c req-0c9a252c-8008-44e8-971c-2c5bcb7516a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b", "tag": "6791e60c-7f12-447e-910f-5ce7bf610d10"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:26:42.446769 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:26:42.446769 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:26:42.453694 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-7b58edd0-14f3-423b-8e2d-e9bd02907a5c req-0c9a252c-8008-44e8-971c-2c5bcb7516a9 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:26:42.454611 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-7b58edd0-14f3-423b-8e2d-e9bd02907a5c req-0c9a252c-8008-44e8-971c-2c5bcb7516a9 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:26:42.465122 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-7b58edd0-14f3-423b-8e2d-e9bd02907a5c req-0c9a252c-8008-44e8-971c-2c5bcb7516a9 service nova] Creating event network-changed:6791e60c-7f12-447e-910f-5ce7bf610d10 for instance e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b on hv-cinder-81571 Oct 28 12:26:42.470096 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-7b58edd0-14f3-423b-8e2d-e9bd02907a5c req-0c9a252c-8008-44e8-971c-2c5bcb7516a9 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029488 Oct 28 12:26:42.470625 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 763/1545] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:26:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:27:52.960033 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-271f9a69-c32c-4272-96f4-bcd166fd7ed9 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:27:52.961017 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-271f9a69-c32c-4272-96f4-bcd166fd7ed9 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:27:52.966951 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-271f9a69-c32c-4272-96f4-bcd166fd7ed9 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:27:52.967400 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-271f9a69-c32c-4272-96f4-bcd166fd7ed9 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:27:52.968167 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-271f9a69-c32c-4272-96f4-bcd166fd7ed9 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:27:52.968661 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-271f9a69-c32c-4272-96f4-bcd166fd7ed9 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:27:53.046873 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-271f9a69-c32c-4272-96f4-bcd166fd7ed9 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "POST /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b/action" status: 202 len: 0 microversion: 2.1 time: 0.091251 Oct 28 12:27:53.047508 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 783/1546] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:27:52 2021] POST /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:27:53.057268 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d7492fbb-390e-4330-a775-7f3235eaa069 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:27:53.058599 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d7492fbb-390e-4330-a775-7f3235eaa069 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:27:53.064909 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d7492fbb-390e-4330-a775-7f3235eaa069 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:27:53.065396 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d7492fbb-390e-4330-a775-7f3235eaa069 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:27:53.066204 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d7492fbb-390e-4330-a775-7f3235eaa069 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:27:53.066634 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d7492fbb-390e-4330-a775-7f3235eaa069 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:27:53.257546 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d7492fbb-390e-4330-a775-7f3235eaa069 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:27:53.265931 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d7492fbb-390e-4330-a775-7f3235eaa069 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1752 microversion: 2.1 time: 0.213914 Oct 28 12:27:53.266513 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 764/1547] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:27:53 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1752 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:27:54.285705 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f7e15ce7-dff4-4752-b996-062fd0626407 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:27:54.286389 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f7e15ce7-dff4-4752-b996-062fd0626407 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:27:54.292771 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f7e15ce7-dff4-4752-b996-062fd0626407 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:27:54.293222 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f7e15ce7-dff4-4752-b996-062fd0626407 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:27:54.293990 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f7e15ce7-dff4-4752-b996-062fd0626407 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:27:54.294412 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f7e15ce7-dff4-4752-b996-062fd0626407 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:27:54.471614 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-f7e15ce7-dff4-4752-b996-062fd0626407 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:27:54.479856 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f7e15ce7-dff4-4752-b996-062fd0626407 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1757 microversion: 2.1 time: 0.198255 Oct 28 12:27:54.480467 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 784/1548] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:27:54 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1757 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:27:55.497315 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-ed94dab4-da50-4a10-b3d8-e67f00f92403 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:27:55.497926 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-ed94dab4-da50-4a10-b3d8-e67f00f92403 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:27:55.503828 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed94dab4-da50-4a10-b3d8-e67f00f92403 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:27:55.504261 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed94dab4-da50-4a10-b3d8-e67f00f92403 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:27:55.505018 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed94dab4-da50-4a10-b3d8-e67f00f92403 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:27:55.505435 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-ed94dab4-da50-4a10-b3d8-e67f00f92403 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:27:55.628072 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-ed94dab4-da50-4a10-b3d8-e67f00f92403 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:27:55.636345 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-ed94dab4-da50-4a10-b3d8-e67f00f92403 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1757 microversion: 2.1 time: 0.142355 Oct 28 12:27:55.636901 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 765/1549] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:27:55 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1757 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:27:56.653632 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c19c5e74-ad7f-4e36-972d-7af15230f55c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:27:56.654449 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c19c5e74-ad7f-4e36-972d-7af15230f55c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:27:56.661173 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c19c5e74-ad7f-4e36-972d-7af15230f55c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:27:56.661610 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c19c5e74-ad7f-4e36-972d-7af15230f55c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:27:56.662370 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c19c5e74-ad7f-4e36-972d-7af15230f55c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:27:56.662825 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c19c5e74-ad7f-4e36-972d-7af15230f55c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:27:56.787896 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c19c5e74-ad7f-4e36-972d-7af15230f55c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:27:56.796350 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c19c5e74-ad7f-4e36-972d-7af15230f55c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1757 microversion: 2.1 time: 0.146831 Oct 28 12:27:56.796908 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 785/1550] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:27:56 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1757 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:27:57.812963 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-5d1c7472-b2cd-48b2-a367-3cc9998463cf tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:27:57.813608 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-5d1c7472-b2cd-48b2-a367-3cc9998463cf tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:27:57.819807 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d1c7472-b2cd-48b2-a367-3cc9998463cf tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:27:57.820251 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d1c7472-b2cd-48b2-a367-3cc9998463cf tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:27:57.821014 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d1c7472-b2cd-48b2-a367-3cc9998463cf tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:27:57.821444 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-5d1c7472-b2cd-48b2-a367-3cc9998463cf tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:27:57.944986 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-5d1c7472-b2cd-48b2-a367-3cc9998463cf tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:27:57.953386 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-5d1c7472-b2cd-48b2-a367-3cc9998463cf tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1757 microversion: 2.1 time: 0.144260 Oct 28 12:27:57.953951 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 766/1551] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:27:57 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1757 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:27:58.970573 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-c785a12d-d63e-46f5-ad71-e2c6cabd218a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:27:58.971202 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-c785a12d-d63e-46f5-ad71-e2c6cabd218a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:27:58.977434 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c785a12d-d63e-46f5-ad71-e2c6cabd218a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:27:58.977873 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c785a12d-d63e-46f5-ad71-e2c6cabd218a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:27:58.978700 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c785a12d-d63e-46f5-ad71-e2c6cabd218a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:27:58.979207 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-c785a12d-d63e-46f5-ad71-e2c6cabd218a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:27:59.107913 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-c785a12d-d63e-46f5-ad71-e2c6cabd218a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:27:59.115586 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-c785a12d-d63e-46f5-ad71-e2c6cabd218a tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1757 microversion: 2.1 time: 0.148732 Oct 28 12:27:59.116155 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 786/1552] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:27:58 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1757 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:28:00.132116 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-4e04996b-5fff-4672-9798-8dd234f41dcf tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:00.132724 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-4e04996b-5fff-4672-9798-8dd234f41dcf tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:28:00.139227 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4e04996b-5fff-4672-9798-8dd234f41dcf tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:00.139676 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4e04996b-5fff-4672-9798-8dd234f41dcf tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:00.140441 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4e04996b-5fff-4672-9798-8dd234f41dcf tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:00.140870 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-4e04996b-5fff-4672-9798-8dd234f41dcf tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:00.268994 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-4e04996b-5fff-4672-9798-8dd234f41dcf tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:28:00.276634 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-4e04996b-5fff-4672-9798-8dd234f41dcf tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1757 microversion: 2.1 time: 0.148292 Oct 28 12:28:00.277197 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 767/1553] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:28:00 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1757 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:28:01.295548 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-13c93d9b-9135-4d46-8ed1-86792f9a5d21 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:01.296667 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-13c93d9b-9135-4d46-8ed1-86792f9a5d21 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:28:01.303218 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-13c93d9b-9135-4d46-8ed1-86792f9a5d21 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:01.303656 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-13c93d9b-9135-4d46-8ed1-86792f9a5d21 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:01.304427 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-13c93d9b-9135-4d46-8ed1-86792f9a5d21 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:01.304885 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-13c93d9b-9135-4d46-8ed1-86792f9a5d21 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:01.429906 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-13c93d9b-9135-4d46-8ed1-86792f9a5d21 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:28:01.438220 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-13c93d9b-9135-4d46-8ed1-86792f9a5d21 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1757 microversion: 2.1 time: 0.147208 Oct 28 12:28:01.438884 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 787/1554] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:28:01 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1757 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:28:02.455859 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-55987e5d-9237-44ad-91f8-9227c59e4dce tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:02.456455 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-55987e5d-9237-44ad-91f8-9227c59e4dce tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:28:02.462738 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-55987e5d-9237-44ad-91f8-9227c59e4dce tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:02.463176 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-55987e5d-9237-44ad-91f8-9227c59e4dce tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:02.463947 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-55987e5d-9237-44ad-91f8-9227c59e4dce tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:02.464374 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-55987e5d-9237-44ad-91f8-9227c59e4dce tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:02.591696 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-55987e5d-9237-44ad-91f8-9227c59e4dce tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:28:02.599447 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-55987e5d-9237-44ad-91f8-9227c59e4dce tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1757 microversion: 2.1 time: 0.147260 Oct 28 12:28:02.600014 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 768/1555] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:28:02 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1757 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:28:03.616407 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-172556ec-ac11-487b-842a-6974828ba3f3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:03.617012 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-172556ec-ac11-487b-842a-6974828ba3f3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:28:03.624488 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-172556ec-ac11-487b-842a-6974828ba3f3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:03.624947 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-172556ec-ac11-487b-842a-6974828ba3f3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:03.625723 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-172556ec-ac11-487b-842a-6974828ba3f3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:03.626145 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-172556ec-ac11-487b-842a-6974828ba3f3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:03.754089 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-172556ec-ac11-487b-842a-6974828ba3f3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:28:03.761717 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-172556ec-ac11-487b-842a-6974828ba3f3 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1757 microversion: 2.1 time: 0.148949 Oct 28 12:28:03.762278 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 788/1556] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:28:03 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1757 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:28:04.778741 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-18aa96a2-2c4b-4b1d-b9a7-103f11193de5 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:04.779298 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-18aa96a2-2c4b-4b1d-b9a7-103f11193de5 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:28:04.785915 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18aa96a2-2c4b-4b1d-b9a7-103f11193de5 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:04.786357 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18aa96a2-2c4b-4b1d-b9a7-103f11193de5 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:04.787177 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18aa96a2-2c4b-4b1d-b9a7-103f11193de5 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:04.787612 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-18aa96a2-2c4b-4b1d-b9a7-103f11193de5 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:04.915588 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-18aa96a2-2c4b-4b1d-b9a7-103f11193de5 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:28:04.925352 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-18aa96a2-2c4b-4b1d-b9a7-103f11193de5 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1760 microversion: 2.1 time: 0.150333 Oct 28 12:28:04.925957 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 769/1557] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:28:04 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1760 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:28:27.116283 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-a65c5e1e-9377-40ef-b648-c23bf98a24c9 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:27.117554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-94e2457e-0183-4f5d-9bf5-3fbcb327fa1d req-53015d04-60db-4c0a-b1f2-8432aa5060db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd609dc2-6004-43aa-a771-b4c659a3d27e", "tag": "fee1be39-2573-4a6e-aa44-b3788989968b"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:28:27.122297 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a65c5e1e-9377-40ef-b648-c23bf98a24c9 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:28:27.122719 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:28:27.122719 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:28:27.126136 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a65c5e1e-9377-40ef-b648-c23bf98a24c9 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:27.126756 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a65c5e1e-9377-40ef-b648-c23bf98a24c9 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:27.128306 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a65c5e1e-9377-40ef-b648-c23bf98a24c9 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:27.129085 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-a65c5e1e-9377-40ef-b648-c23bf98a24c9 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:27.134422 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-94e2457e-0183-4f5d-9bf5-3fbcb327fa1d req-53015d04-60db-4c0a-b1f2-8432aa5060db service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:27.134422 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-94e2457e-0183-4f5d-9bf5-3fbcb327fa1d req-53015d04-60db-4c0a-b1f2-8432aa5060db service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:27.161554 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-94e2457e-0183-4f5d-9bf5-3fbcb327fa1d req-53015d04-60db-4c0a-b1f2-8432aa5060db service nova] Creating event network-changed:fee1be39-2573-4a6e-aa44-b3788989968b for instance dd609dc2-6004-43aa-a771-b4c659a3d27e on hv-cinder-81571 Oct 28 12:28:27.171475 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-94e2457e-0183-4f5d-9bf5-3fbcb327fa1d req-53015d04-60db-4c0a-b1f2-8432aa5060db service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059625 Oct 28 12:28:27.172521 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-a65c5e1e-9377-40ef-b648-c23bf98a24c9 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:28:27.172874 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 770/1558] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:28:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:28:27.308459 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-a65c5e1e-9377-40ef-b648-c23bf98a24c9 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "DELETE /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 204 len: 0 microversion: 2.1 time: 0.196706 Oct 28 12:28:27.309681 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 789/1559] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:28:27 2021] DELETE /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:28:27.324596 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-0346ac14-fd21-4fd4-9e9e-409ca0e1f60b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:27.327638 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-0346ac14-fd21-4fd4-9e9e-409ca0e1f60b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:28:27.347154 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0346ac14-fd21-4fd4-9e9e-409ca0e1f60b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:27.348464 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0346ac14-fd21-4fd4-9e9e-409ca0e1f60b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:27.349952 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0346ac14-fd21-4fd4-9e9e-409ca0e1f60b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:27.350782 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-0346ac14-fd21-4fd4-9e9e-409ca0e1f60b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:27.519942 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-0346ac14-fd21-4fd4-9e9e-409ca0e1f60b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:28:27.529134 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-0346ac14-fd21-4fd4-9e9e-409ca0e1f60b tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1577 microversion: 2.1 time: 0.213811 Oct 28 12:28:27.530134 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 771/1560] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:28:27 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1577 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:28:28.555966 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-b5ee024f-7cca-48c1-aff3-5b03f0be06dc tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:28.556693 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-b5ee024f-7cca-48c1-aff3-5b03f0be06dc tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:28:28.565201 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b5ee024f-7cca-48c1-aff3-5b03f0be06dc tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:28.565816 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b5ee024f-7cca-48c1-aff3-5b03f0be06dc tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:28.566902 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b5ee024f-7cca-48c1-aff3-5b03f0be06dc tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:28.567466 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-b5ee024f-7cca-48c1-aff3-5b03f0be06dc tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:28.706035 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-b5ee024f-7cca-48c1-aff3-5b03f0be06dc tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:28:28.713509 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-b5ee024f-7cca-48c1-aff3-5b03f0be06dc tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1458 microversion: 2.1 time: 0.161454 Oct 28 12:28:28.713999 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 790/1561] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:28:28 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1458 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:28:28.829579 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:28:28.829879 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: Thu Oct 28 12:28:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:28:29.736226 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3a7acf58-eef8-4003-a3df-6af2def52d19 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:29.737142 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-2f021e76-8739-4ade-9e83-ecfadabb79bb req-78e0d8b1-b617-457a-9784-e67775398f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd609dc2-6004-43aa-a771-b4c659a3d27e", "name": "network-vif-deleted", "tag": "fee1be39-2573-4a6e-aa44-b3788989968b"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:28:29.737734 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3a7acf58-eef8-4003-a3df-6af2def52d19 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:28:29.738293 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:28:29.738293 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:28:29.745432 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-2f021e76-8739-4ade-9e83-ecfadabb79bb req-78e0d8b1-b617-457a-9784-e67775398f97 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:29.745869 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-2f021e76-8739-4ade-9e83-ecfadabb79bb req-78e0d8b1-b617-457a-9784-e67775398f97 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:29.748009 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a7acf58-eef8-4003-a3df-6af2def52d19 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:29.748757 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a7acf58-eef8-4003-a3df-6af2def52d19 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:29.750094 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a7acf58-eef8-4003-a3df-6af2def52d19 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:29.750872 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3a7acf58-eef8-4003-a3df-6af2def52d19 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:29.757274 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-2f021e76-8739-4ade-9e83-ecfadabb79bb req-78e0d8b1-b617-457a-9784-e67775398f97 service nova] Creating event network-vif-deleted:fee1be39-2573-4a6e-aa44-b3788989968b for instance dd609dc2-6004-43aa-a771-b4c659a3d27e on hv-cinder-81571 Oct 28 12:28:29.762740 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-2f021e76-8739-4ade-9e83-ecfadabb79bb req-78e0d8b1-b617-457a-9784-e67775398f97 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105727 Oct 28 12:28:29.763337 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 772/1562] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:28:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:28:29.836277 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3a7acf58-eef8-4003-a3df-6af2def52d19 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:28:29.844585 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3a7acf58-eef8-4003-a3df-6af2def52d19 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 200 len: 1224 microversion: 2.1 time: 0.115542 Oct 28 12:28:29.845149 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 791/1563] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:28:29 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 1224 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:28:30.866860 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-12a8df99-7cac-4f53-b162-9af8e16a29b4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:30.868082 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-12a8df99-7cac-4f53-b162-9af8e16a29b4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: dd609dc2-6004-43aa-a771-b4c659a3d27e] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:28:30.879303 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-12a8df99-7cac-4f53-b162-9af8e16a29b4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:30.880076 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-12a8df99-7cac-4f53-b162-9af8e16a29b4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:30.881416 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-12a8df99-7cac-4f53-b162-9af8e16a29b4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:30.882173 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-12a8df99-7cac-4f53-b162-9af8e16a29b4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:30.906042 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-12a8df99-7cac-4f53-b162-9af8e16a29b4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] HTTP exception thrown: Instance dd609dc2-6004-43aa-a771-b4c659a3d27e could not be found. Oct 28 12:28:30.907171 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-12a8df99-7cac-4f53-b162-9af8e16a29b4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Returning 404 to user: Instance dd609dc2-6004-43aa-a771-b4c659a3d27e could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:28:30.908603 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-12a8df99-7cac-4f53-b162-9af8e16a29b4 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e" status: 404 len: 111 microversion: 2.1 time: 0.049653 Oct 28 12:28:30.909530 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 773/1564] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:28:30 2021] GET /compute/v2.1/servers/dd609dc2-6004-43aa-a771-b4c659a3d27e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:28:34.030609 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-94d54441-15e5-430c-aef1-92d210826fbf tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:34.031429 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-94d54441-15e5-430c-aef1-92d210826fbf tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:28:34.033913 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-7e06aa0c-f0db-416c-be0a-0a44a7cde058 req-e40b50f1-22b6-4d37-9596-220fa8a783ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4023905f-5420-4e27-99bd-a9465bb7c9ac", "tag": "27692bcf-cac2-47f5-bc7e-a77918b203e2"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:28:34.035762 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:28:34.035762 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:28:34.039563 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-94d54441-15e5-430c-aef1-92d210826fbf tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:34.040335 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-94d54441-15e5-430c-aef1-92d210826fbf tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:34.041240 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-94d54441-15e5-430c-aef1-92d210826fbf tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:34.041971 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-94d54441-15e5-430c-aef1-92d210826fbf tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:34.044556 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-7e06aa0c-f0db-416c-be0a-0a44a7cde058 req-e40b50f1-22b6-4d37-9596-220fa8a783ea service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:34.045083 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-7e06aa0c-f0db-416c-be0a-0a44a7cde058 req-e40b50f1-22b6-4d37-9596-220fa8a783ea service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:34.057464 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-7e06aa0c-f0db-416c-be0a-0a44a7cde058 req-e40b50f1-22b6-4d37-9596-220fa8a783ea service nova] Creating event network-changed:27692bcf-cac2-47f5-bc7e-a77918b203e2 for instance 4023905f-5420-4e27-99bd-a9465bb7c9ac on hv-cinder-81571 Oct 28 12:28:34.065436 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-7e06aa0c-f0db-416c-be0a-0a44a7cde058 req-e40b50f1-22b6-4d37-9596-220fa8a783ea service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035237 Oct 28 12:28:34.066435 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 774/1565] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:28:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:28:34.074936 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-94d54441-15e5-430c-aef1-92d210826fbf tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:28:34.164625 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-94d54441-15e5-430c-aef1-92d210826fbf tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "DELETE /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 204 len: 0 microversion: 2.1 time: 0.139635 Oct 28 12:28:34.166548 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 792/1566] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:28:34 2021] DELETE /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:28:34.182990 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-d25c4960-092b-4754-9066-dd88154ae7d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:34.184225 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-d25c4960-092b-4754-9066-dd88154ae7d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:28:34.194596 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d25c4960-092b-4754-9066-dd88154ae7d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:34.195409 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d25c4960-092b-4754-9066-dd88154ae7d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:34.196756 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d25c4960-092b-4754-9066-dd88154ae7d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:34.197513 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-d25c4960-092b-4754-9066-dd88154ae7d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:34.384467 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-d25c4960-092b-4754-9066-dd88154ae7d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:28:34.392920 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-d25c4960-092b-4754-9066-dd88154ae7d8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 200 len: 1577 microversion: 2.1 time: 0.217154 Oct 28 12:28:34.393693 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 775/1567] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:28:34 2021] GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 1577 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:28:35.413595 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-3b8da3d8-729f-4205-8398-1b065b9708f8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:35.414358 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-3b8da3d8-729f-4205-8398-1b065b9708f8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:28:35.421840 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3b8da3d8-729f-4205-8398-1b065b9708f8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:35.422284 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3b8da3d8-729f-4205-8398-1b065b9708f8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:35.423092 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3b8da3d8-729f-4205-8398-1b065b9708f8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:35.423516 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-3b8da3d8-729f-4205-8398-1b065b9708f8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:35.547178 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-3b8da3d8-729f-4205-8398-1b065b9708f8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:28:35.555221 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-3b8da3d8-729f-4205-8398-1b065b9708f8 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 200 len: 1458 microversion: 2.1 time: 0.147567 Oct 28 12:28:35.555795 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 793/1568] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:28:35 2021] GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 1458 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:28:36.380683 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-34817e47-bde7-4518-8d58-08ff9fd1173f req-e5cc2c46-2b41-40d7-867a-194fefbe1e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4023905f-5420-4e27-99bd-a9465bb7c9ac", "name": "network-vif-deleted", "tag": "27692bcf-cac2-47f5-bc7e-a77918b203e2"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:28:36.382760 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:28:36.382760 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:28:36.392770 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-34817e47-bde7-4518-8d58-08ff9fd1173f req-e5cc2c46-2b41-40d7-867a-194fefbe1e72 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:36.393143 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-34817e47-bde7-4518-8d58-08ff9fd1173f req-e5cc2c46-2b41-40d7-867a-194fefbe1e72 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:36.405628 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-34817e47-bde7-4518-8d58-08ff9fd1173f req-e5cc2c46-2b41-40d7-867a-194fefbe1e72 service nova] Creating event network-vif-deleted:27692bcf-cac2-47f5-bc7e-a77918b203e2 for instance 4023905f-5420-4e27-99bd-a9465bb7c9ac on hv-cinder-81571 Oct 28 12:28:36.413001 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-34817e47-bde7-4518-8d58-08ff9fd1173f req-e5cc2c46-2b41-40d7-867a-194fefbe1e72 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035709 Oct 28 12:28:36.413787 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 776/1569] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:28:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:28:36.577064 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-8fb556bd-2a83-4a88-a89a-f4a5fae1af06 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:36.578463 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-8fb556bd-2a83-4a88-a89a-f4a5fae1af06 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:28:36.590456 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8fb556bd-2a83-4a88-a89a-f4a5fae1af06 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:36.591513 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8fb556bd-2a83-4a88-a89a-f4a5fae1af06 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:36.593025 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8fb556bd-2a83-4a88-a89a-f4a5fae1af06 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:36.593814 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-8fb556bd-2a83-4a88-a89a-f4a5fae1af06 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:36.676332 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-8fb556bd-2a83-4a88-a89a-f4a5fae1af06 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cb6619f170a4a2295b89558706885bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa9219e414f4bd49dcbf215ed8d6f35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:28:36.691173 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-8fb556bd-2a83-4a88-a89a-f4a5fae1af06 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 200 len: 1224 microversion: 2.1 time: 0.121701 Oct 28 12:28:36.692169 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 794/1570] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:28:36 2021] GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 1224 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:28:37.710154 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a2d6400a-e63f-483d-b160-bf257cd5ddba tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:37.710873 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-a2d6400a-e63f-483d-b160-bf257cd5ddba tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 4023905f-5420-4e27-99bd-a9465bb7c9ac] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:28:37.717674 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a2d6400a-e63f-483d-b160-bf257cd5ddba tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:37.718116 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a2d6400a-e63f-483d-b160-bf257cd5ddba tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:37.718931 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a2d6400a-e63f-483d-b160-bf257cd5ddba tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:37.719392 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-a2d6400a-e63f-483d-b160-bf257cd5ddba tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:37.732950 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-a2d6400a-e63f-483d-b160-bf257cd5ddba tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] HTTP exception thrown: Instance 4023905f-5420-4e27-99bd-a9465bb7c9ac could not be found. Oct 28 12:28:37.733531 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-a2d6400a-e63f-483d-b160-bf257cd5ddba tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Returning 404 to user: Instance 4023905f-5420-4e27-99bd-a9465bb7c9ac could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:28:37.734341 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-a2d6400a-e63f-483d-b160-bf257cd5ddba tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac" status: 404 len: 111 microversion: 2.1 time: 0.028752 Oct 28 12:28:37.734913 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 777/1571] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:28:37 2021] GET /compute/v2.1/servers/4023905f-5420-4e27-99bd-a9465bb7c9ac => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:28:38.200754 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-213d9921-47f3-4994-9404-93cbc97a7f71 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:38.201639 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-213d9921-47f3-4994-9404-93cbc97a7f71 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:28:38.212207 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-213d9921-47f3-4994-9404-93cbc97a7f71 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:38.212887 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-213d9921-47f3-4994-9404-93cbc97a7f71 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:38.214197 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-213d9921-47f3-4994-9404-93cbc97a7f71 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:38.214983 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-213d9921-47f3-4994-9404-93cbc97a7f71 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:38.237992 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.wsgi [None req-213d9921-47f3-4994-9404-93cbc97a7f71 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] HTTP exception thrown: Instance 99f8b97f-0bb9-426b-939a-83aec5bd97be could not be found. Oct 28 12:28:38.239016 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-213d9921-47f3-4994-9404-93cbc97a7f71 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Returning 404 to user: Instance 99f8b97f-0bb9-426b-939a-83aec5bd97be could not be found. {{(pid=115798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:28:38.240452 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-213d9921-47f3-4994-9404-93cbc97a7f71 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "DELETE /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 404 len: 111 microversion: 2.1 time: 0.046898 Oct 28 12:28:38.241107 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 795/1572] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:28:38 2021] DELETE /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:28:38.254860 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3597567e-23fb-4fd3-85dd-4dd6aacaef90 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:38.255959 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-3597567e-23fb-4fd3-85dd-4dd6aacaef90 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] [instance: 99f8b97f-0bb9-426b-939a-83aec5bd97be] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:28:38.266198 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3597567e-23fb-4fd3-85dd-4dd6aacaef90 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:38.267004 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3597567e-23fb-4fd3-85dd-4dd6aacaef90 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:38.268359 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3597567e-23fb-4fd3-85dd-4dd6aacaef90 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:28:38.269129 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-3597567e-23fb-4fd3-85dd-4dd6aacaef90 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:28:38.289893 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-3597567e-23fb-4fd3-85dd-4dd6aacaef90 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] HTTP exception thrown: Instance 99f8b97f-0bb9-426b-939a-83aec5bd97be could not be found. Oct 28 12:28:38.290509 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-3597567e-23fb-4fd3-85dd-4dd6aacaef90 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Returning 404 to user: Instance 99f8b97f-0bb9-426b-939a-83aec5bd97be could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:28:38.291369 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-3597567e-23fb-4fd3-85dd-4dd6aacaef90 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be" status: 404 len: 111 microversion: 2.1 time: 0.043479 Oct 28 12:28:38.291925 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 778/1573] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:28:38 2021] GET /compute/v2.1/servers/99f8b97f-0bb9-426b-939a-83aec5bd97be => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:28:39.629911 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-d5e0fb3f-2f73-4e6a-a55c-5a122fcb6744 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] Calling method '.version_select at 0x7f11f377e040>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:28:39.671851 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-d5e0fb3f-2f73-4e6a-a55c-5a122fcb6744 tempest-TestVolumeBootPattern-1187862242 tempest-TestVolumeBootPattern-1187862242-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-372409146" status: 202 len: 0 microversion: 2.1 time: 0.045817 Oct 28 12:28:39.672571 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 796/1574] 10.222.0.37 () {58 vars in 1259 bytes} [Thu Oct 28 12:28:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-372409146 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:29:08.269847 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-60c8ce17-78a0-433d-b052-7a894b780892 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1988616771"}} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:29:08.270671 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-60c8ce17-78a0-433d-b052-7a894b780892 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:29:08.276815 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60c8ce17-78a0-433d-b052-7a894b780892 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:08.277250 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60c8ce17-78a0-433d-b052-7a894b780892 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:08.278020 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60c8ce17-78a0-433d-b052-7a894b780892 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:08.278442 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-60c8ce17-78a0-433d-b052-7a894b780892 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:08.415452 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.network.security_group_api [None req-60c8ce17-78a0-433d-b052-7a894b780892 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Removing security group 21434db0-0a82-4316-9754-f480353ae6be from port 6791e60c-7f12-447e-910f-5ce7bf610d10 Oct 28 12:29:08.807708 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-60c8ce17-78a0-433d-b052-7a894b780892 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "POST /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b/action" status: 202 len: 0 microversion: 2.1 time: 0.541585 Oct 28 12:29:08.808210 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 779/1575] 10.222.0.37 () {60 vars in 1277 bytes} [Thu Oct 28 12:29:08 2021] POST /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:29:08.826177 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-b768f49b-be9c-4af9-ae97-1b967bf6856f req-0aa85c9e-9436-45cf-8359-51d427716d4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b", "tag": "6791e60c-7f12-447e-910f-5ce7bf610d10"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:29:08.832087 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:29:08.832087 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:29:08.849769 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-b768f49b-be9c-4af9-ae97-1b967bf6856f req-0aa85c9e-9436-45cf-8359-51d427716d4f service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:08.851269 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-b768f49b-be9c-4af9-ae97-1b967bf6856f req-0aa85c9e-9436-45cf-8359-51d427716d4f service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:08.878111 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-b768f49b-be9c-4af9-ae97-1b967bf6856f req-0aa85c9e-9436-45cf-8359-51d427716d4f service nova] Creating event network-changed:6791e60c-7f12-447e-910f-5ce7bf610d10 for instance e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b on hv-cinder-81571 Oct 28 12:29:08.889809 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-b768f49b-be9c-4af9-ae97-1b967bf6856f req-0aa85c9e-9436-45cf-8359-51d427716d4f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072962 Oct 28 12:29:08.892715 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 797/1576] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:29:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:29:10.482921 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-dc9c82b0-31cd-48ee-9310-9dcdec192c1f tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:29:10.483651 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-dc9c82b0-31cd-48ee-9310-9dcdec192c1f tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:29:10.491490 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dc9c82b0-31cd-48ee-9310-9dcdec192c1f tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:10.491926 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dc9c82b0-31cd-48ee-9310-9dcdec192c1f tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:10.496646 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dc9c82b0-31cd-48ee-9310-9dcdec192c1f tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:10.496646 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-dc9c82b0-31cd-48ee-9310-9dcdec192c1f tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:10.596109 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.objects.instance [None req-dc9c82b0-31cd-48ee-9310-9dcdec192c1f tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lazy-loading 'services' on Instance uuid e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b {{(pid=115797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 12:29:10.689984 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-dc9c82b0-31cd-48ee-9310-9dcdec192c1f tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b/os-volume_attachments/09c1c979-0d24-4ead-b674-6826707ff685" status: 202 len: 0 microversion: 2.1 time: 0.212899 Oct 28 12:29:10.691172 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 780/1577] 10.222.0.37 () {58 vars in 1415 bytes} [Thu Oct 28 12:29:10 2021] DELETE /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b/os-volume_attachments/09c1c979-0d24-4ead-b674-6826707ff685 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 12:29:10.704834 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-f07ec702-a9f5-425d-87a1-909bd882d2d7 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:29:10.706629 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-f07ec702-a9f5-425d-87a1-909bd882d2d7 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:29:10.717431 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f07ec702-a9f5-425d-87a1-909bd882d2d7 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:10.718266 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f07ec702-a9f5-425d-87a1-909bd882d2d7 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:10.719773 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f07ec702-a9f5-425d-87a1-909bd882d2d7 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:10.720304 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-f07ec702-a9f5-425d-87a1-909bd882d2d7 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:10.766835 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-f07ec702-a9f5-425d-87a1-909bd882d2d7 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070025 Oct 28 12:29:10.767247 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 798/1578] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:29:10 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:29:10.908817 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [req-f5b120a0-a7e9-48d0-a834-13b50b8c250a req-e03d6187-e3bc-45d2-9884-22a57d2d0150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b", "tag": "6791e60c-7f12-447e-910f-5ce7bf610d10"}]} {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:29:10.910468 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:29:10.910468 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: warnings.warn(msg) Oct 28 12:29:10.919422 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-f5b120a0-a7e9-48d0-a834-13b50b8c250a req-e03d6187-e3bc-45d2-9884-22a57d2d0150 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:10.919965 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [req-f5b120a0-a7e9-48d0-a834-13b50b8c250a req-e03d6187-e3bc-45d2-9884-22a57d2d0150 service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:10.933674 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.compute.server_external_events [req-f5b120a0-a7e9-48d0-a834-13b50b8c250a req-e03d6187-e3bc-45d2-9884-22a57d2d0150 service nova] Creating event network-changed:6791e60c-7f12-447e-910f-5ce7bf610d10 for instance e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b on hv-cinder-81571 Oct 28 12:29:10.941273 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [req-f5b120a0-a7e9-48d0-a834-13b50b8c250a req-e03d6187-e3bc-45d2-9884-22a57d2d0150 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035469 Oct 28 12:29:10.942463 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 781/1579] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:29:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:29:11.628670 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:29:11.628831 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: Thu Oct 28 12:29:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:29:11.784865 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-043a1c34-85d6-4a41-ac5d-764197d2b255 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:29:11.785846 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-043a1c34-85d6-4a41-ac5d-764197d2b255 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:29:11.792488 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-043a1c34-85d6-4a41-ac5d-764197d2b255 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:11.792943 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-043a1c34-85d6-4a41-ac5d-764197d2b255 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:11.794002 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-043a1c34-85d6-4a41-ac5d-764197d2b255 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:11.794644 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-043a1c34-85d6-4a41-ac5d-764197d2b255 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:11.824843 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-043a1c34-85d6-4a41-ac5d-764197d2b255 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048814 Oct 28 12:29:11.825700 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 799/1580] 10.222.0.37 () {58 vars in 1301 bytes} [Thu Oct 28 12:29:11 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 12:29:11.842846 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-33cd3d43-f62b-4144-a3a6-31f1c06b3fde tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:29:11.843854 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-33cd3d43-f62b-4144-a3a6-31f1c06b3fde tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:29:11.852893 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-33cd3d43-f62b-4144-a3a6-31f1c06b3fde tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:11.853385 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-33cd3d43-f62b-4144-a3a6-31f1c06b3fde tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:11.854427 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-33cd3d43-f62b-4144-a3a6-31f1c06b3fde tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:11.854986 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-33cd3d43-f62b-4144-a3a6-31f1c06b3fde tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:11.940212 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-33cd3d43-f62b-4144-a3a6-31f1c06b3fde tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] HTTP exception thrown: Instance e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b is not attached to volume 09c1c979-0d24-4ead-b674-6826707ff685 Oct 28 12:29:11.940985 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-33cd3d43-f62b-4144-a3a6-31f1c06b3fde tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Returning 404 to user: Instance e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b is not attached to volume 09c1c979-0d24-4ead-b674-6826707ff685 {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:29:11.941840 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-33cd3d43-f62b-4144-a3a6-31f1c06b3fde tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b/os-volume_attachments/09c1c979-0d24-4ead-b674-6826707ff685" status: 404 len: 154 microversion: 2.1 time: 0.106757 Oct 28 12:29:11.942407 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 782/1581] 10.222.0.37 () {58 vars in 1415 bytes} [Thu Oct 28 12:29:11 2021] DELETE /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b/os-volume_attachments/09c1c979-0d24-4ead-b674-6826707ff685 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:29:12.269474 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:29:12.269742 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: Thu Oct 28 12:29:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:29:13.085917 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-4436d4cb-7b76-47d0-931c-ca33179c38ab tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:29:13.086888 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4436d4cb-7b76-47d0-931c-ca33179c38ab tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:29:13.096481 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4436d4cb-7b76-47d0-931c-ca33179c38ab tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:13.096922 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4436d4cb-7b76-47d0-931c-ca33179c38ab tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:13.097702 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4436d4cb-7b76-47d0-931c-ca33179c38ab tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:13.098127 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-4436d4cb-7b76-47d0-931c-ca33179c38ab tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:13.124101 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-4436d4cb-7b76-47d0-931c-ca33179c38ab tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Going to try to terminate instance {{(pid=115798) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 12:29:13.201916 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-4436d4cb-7b76-47d0-931c-ca33179c38ab tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 204 len: 0 microversion: 2.1 time: 0.119817 Oct 28 12:29:13.202514 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 800/1582] 10.222.0.37 () {58 vars in 1238 bytes} [Thu Oct 28 12:29:13 2021] DELETE /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 12:29:13.210730 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-faf4236f-cf09-42c2-bca4-3640400b665c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:29:13.211344 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-faf4236f-cf09-42c2-bca4-3640400b665c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:29:13.219160 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-faf4236f-cf09-42c2-bca4-3640400b665c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:13.219609 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-faf4236f-cf09-42c2-bca4-3640400b665c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:13.220391 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-faf4236f-cf09-42c2-bca4-3640400b665c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:13.220824 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-faf4236f-cf09-42c2-bca4-3640400b665c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:13.352797 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-faf4236f-cf09-42c2-bca4-3640400b665c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:29:13.360459 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-faf4236f-cf09-42c2-bca4-3640400b665c tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1555 microversion: 2.1 time: 0.153664 Oct 28 12:29:13.361030 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 783/1583] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:29:13 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:29:14.378237 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-e03a5b97-dbc8-4666-a90f-14c5ee028f13 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:29:14.378953 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.compute.api [None req-e03a5b97-dbc8-4666-a90f-14c5ee028f13 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115798) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:29:14.385285 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e03a5b97-dbc8-4666-a90f-14c5ee028f13 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:14.385726 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e03a5b97-dbc8-4666-a90f-14c5ee028f13 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:14.386496 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e03a5b97-dbc8-4666-a90f-14c5ee028f13 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:14.386949 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [None req-e03a5b97-dbc8-4666-a90f-14c5ee028f13 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:14.509358 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.policy [None req-e03a5b97-dbc8-4666-a90f-14c5ee028f13 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115798) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:29:14.516745 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-e03a5b97-dbc8-4666-a90f-14c5ee028f13 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1555 microversion: 2.1 time: 0.142494 Oct 28 12:29:14.517317 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 801/1584] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:29:14 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1555 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:29:15.533584 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-e4fc35e7-5710-4a5b-b65d-a72b51126d30 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:29:15.534400 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-e4fc35e7-5710-4a5b-b65d-a72b51126d30 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:29:15.540448 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e4fc35e7-5710-4a5b-b65d-a72b51126d30 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:15.540876 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e4fc35e7-5710-4a5b-b65d-a72b51126d30 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:15.542353 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e4fc35e7-5710-4a5b-b65d-a72b51126d30 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:15.543148 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-e4fc35e7-5710-4a5b-b65d-a72b51126d30 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:15.683092 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.policy [None req-e4fc35e7-5710-4a5b-b65d-a72b51126d30 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '487e114a4fb942dbb1b14431012f0898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50130a23a874c80924d4a3b729798ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115797) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 12:29:15.692248 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-e4fc35e7-5710-4a5b-b65d-a72b51126d30 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 200 len: 1555 microversion: 2.1 time: 0.162202 Oct 28 12:29:15.694027 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 784/1585] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:29:15 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:29:15.731472 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [req-84a6ed2e-3839-4515-aac6-199a23fdef85 req-8dc7c4eb-cf5a-48ac-b082-720e3a9872fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b", "name": "network-vif-deleted", "tag": "6791e60c-7f12-447e-910f-5ce7bf610d10"}]} {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:29:15.733392 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 12:29:15.733392 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: warnings.warn(msg) Oct 28 12:29:15.741635 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-84a6ed2e-3839-4515-aac6-199a23fdef85 req-8dc7c4eb-cf5a-48ac-b082-720e3a9872fc service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:15.742885 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG oslo_concurrency.lockutils [req-84a6ed2e-3839-4515-aac6-199a23fdef85 req-8dc7c4eb-cf5a-48ac-b082-720e3a9872fc service nova] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:15.753777 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.compute.server_external_events [req-84a6ed2e-3839-4515-aac6-199a23fdef85 req-8dc7c4eb-cf5a-48ac-b082-720e3a9872fc service nova] Creating event network-vif-deleted:6791e60c-7f12-447e-910f-5ce7bf610d10 for instance e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b on hv-cinder-81571 Oct 28 12:29:15.759537 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [req-84a6ed2e-3839-4515-aac6-199a23fdef85 req-8dc7c4eb-cf5a-48ac-b082-720e3a9872fc service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032903 Oct 28 12:29:15.760434 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 802/1586] 10.222.0.37 () {64 vars in 1317 bytes} [Thu Oct 28 12:29:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:29:16.710122 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-eaedca04-835d-4d5a-a7b8-e7a89a59f6e8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '>' {{(pid=115797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:29:16.710760 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.compute.api [None req-eaedca04-835d-4d5a-a7b8-e7a89a59f6e8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] [instance: e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b] Fetching instance by UUID {{(pid=115797) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 12:29:16.717870 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-eaedca04-835d-4d5a-a7b8-e7a89a59f6e8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:16.718316 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-eaedca04-835d-4d5a-a7b8-e7a89a59f6e8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:16.719137 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-eaedca04-835d-4d5a-a7b8-e7a89a59f6e8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 12:29:16.719571 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG oslo_concurrency.lockutils [None req-eaedca04-835d-4d5a-a7b8-e7a89a59f6e8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Lock "9fb42506-31a2-4c14-b2b5-bfc6c9f915c9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 12:29:16.734313 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.wsgi [None req-eaedca04-835d-4d5a-a7b8-e7a89a59f6e8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] HTTP exception thrown: Instance e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b could not be found. Oct 28 12:29:16.734942 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: DEBUG nova.api.openstack.wsgi [None req-eaedca04-835d-4d5a-a7b8-e7a89a59f6e8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Returning 404 to user: Instance e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b could not be found. {{(pid=115797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 12:29:16.735767 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO nova.api.openstack.requestlog [None req-eaedca04-835d-4d5a-a7b8-e7a89a59f6e8 tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b" status: 404 len: 111 microversion: 2.1 time: 0.029334 Oct 28 12:29:16.736311 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: [pid: 115797|app: 0|req: 785/1587] 10.222.0.37 () {58 vars in 1235 bytes} [Thu Oct 28 12:29:16 2021] GET /compute/v2.1/servers/e929f0d8-a27d-40c3-b2f8-c8c9f2144d4b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 12:29:16.745068 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: DEBUG nova.api.openstack.wsgi [None req-5d42a43c-f43a-47f4-afdd-02467f49586d tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] Calling method '.version_select at 0x7f11f8253940>' {{(pid=115798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:29:16.763065 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO nova.api.openstack.requestlog [None req-5d42a43c-f43a-47f4-afdd-02467f49586d tempest-TestMinimumBasicScenario-1094965587 tempest-TestMinimumBasicScenario-1094965587-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2042198690" status: 202 len: 0 microversion: 2.1 time: 0.022222 Oct 28 12:29:16.763647 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: [pid: 115798|app: 0|req: 803/1588] 10.222.0.37 () {58 vars in 1271 bytes} [Thu Oct 28 12:29:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2042198690 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 12:29:19.250996 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:29:19.251603 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: Thu Oct 28 12:29:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:31:48.848485 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:31:48.849112 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: Thu Oct 28 12:31:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:32:31.650412 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:32:31.651170 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: Thu Oct 28 12:32:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:32:32.290371 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:32:32.290982 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: Thu Oct 28 12:32:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:32:39.271419 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:32:39.272200 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: Thu Oct 28 12:32:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:34:39.693503 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:34:39.694232 dv-cinder-815712-4-iscsi devstack@n-api.service[115797]: Thu Oct 28 12:34:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 12:34:41.828778 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 12:34:41.829386 dv-cinder-815712-4-iscsi devstack@n-api.service[115798]: Thu Oct 28 12:34:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!